Jobs
>
Johannesburg

    Data Engineering Lead(Big Data) - Johannesburg, South Africa - TalentCru

    talentCRU background
    Description

    The purpose of this role is to lead the technical delivery team, using experience to deliver right sized and well architected solutions in order to meet targets. The successful candidate will be expected to use their experience working in Azure to understand the available technology choices and selectively implement services safely and securely. As well as demonstrable experience working with the technologies and processes, such as Data Bricks, Python, Unity catalog, DevOps (CI/CD) and Plotly.

    The company's Edge platform has been built, from the ground up, to cater for advanced analytics and AI solutions. As such, the successful candidate will be able to work with leading data Scientists, within the company's Data Services team or those that work for our strategic partners and clients.

    Internal Process

    • Responsible for the end-to-end technical solution. This means that key decisions, once discussed and debated, are appropriately understood, and implemented.
    • Collaborate with the Product Development Lead and the Business Enablement Lead to ensure that all stakeholder expectations are met.
    • Ensure that the company's Edge platform can cater to all varieties of data, including batch and real-time, and is safe, secure, scalable, and stable.
    • Manage the work items on behalf of the team, breaking down and assigning work items per sprint. Managing elements of sprint planning.
    • DevOps CI/CD pipeline management, control, and oversight.
    • Engage other platform owners and agree on optimal integration paths and methods.
    • Outstanding communication and presentation skills, with the ability to convey complex concepts to non-technical stakeholders.

    Client Services

    • Ongoing relationship building with internal and external stakeholders to ensure smooth business processing.
    • Ability to develop new improved processes and to facilitate discussions with external and internal stakeholders.
    • Committed to Client experience.
    • Enable business communications between business areas.
    • Participate and contribute to a culture that builds rewarding relationships, facilitates feedback, and provides exceptional client service.
    • Build trust and creditability with respect to Data in the financial market.

    People Management

    • Develop and maintain productive and collaborative working relationships with colleagues, peers, and stakeholders.
    • Continuously develop own expertise in terms of professional, industry, and legislation knowledge.
    • Contribute to continuous innovation through the development, sharing, and implementation of new ideas.
    • Ability to work proactively and independently to deliver precise and accurate work.
    • Take ownership of driving personal career development.
    • Comfortable working with a strictly agile project methodology. This includes breaking down features and user stories for the team of data engineers into appropriately sized deliverables and when required, defining standards, performing code reviews, and validating for quality.
    • Display an inquisitive, detailed-orientated nature, and be unafraid to ask difficult questions, or challenge the status quo when the need arises.
    • Responsible for leveraging financial industry experience to build a modern, secure, scalable solution that is appropriate for the clients and partners that the company services.
    • Makes use of, and develops cost-effective, right-sized solutions and services within Microsoft Azure's Cloud Platform to meet the core platform needs.
    • Displays consideration of the increasing risks faced as a society and as an organisation and suggests appropriate responses with regard to the solutions being built.

    Finance

    • Identify solutions to enhance cost -effectiveness and increase operational efficiency.
    • Provide input into the risk identification processes and communicate recommendations in the appropriate forum.
    • Grade 12 or equivalent
    • A bachelor's degree in computer science or another closely related field
    • 5-8 years of working experience in a related field.
    • Proven work experience as a senior data engineer, or as a Data Engineering Lead
    • Strong Data Bricks and Python skills are a must. SQL skills as an alternative to Python will also be considered
    • Understand how big data solutions / NoSQL solutions differ from standard data solutions and explain why choices made might be different.
    • Mature experience working with cloud services: Azure, AWS, or GCP. This experience will allow the candidate to propose appropriate solutions and alternatives.
    • Strong DevOps understanding, including CI/CD

  • Boardroom Appointments

    Engineering Lead

    3 days ago


    Boardroom Appointments Johannesburg, South Africa

    **Minimum requirements**: · - Post Graduate Degree in Information Technology · - Microsoft Azure Developer or Administrator Certification · - Minimum 3-5 years' experience as a senior manager running a portfolio of 10+ technical experts · - Senior SAP technical skills such as BAS ...

  • Praesignis (Pty) Ltd

    Engineering Lead

    3 days ago


    Praesignis (Pty) Ltd Johannesburg, South Africa

    **Description**: · - To envision, lead and develop fit for purpose, integrated end · - to end technical solutions across multiple technologies for the organisation, through inspirational technical leadership and visionary long-term thinking. · - Provide leadership across multiple ...

  • IQbusiness South Africa

    Engineering Lead

    1 day ago


    IQbusiness South Africa Johannesburg, South Africa

    To envision, lead and develop fit for purpose, integrated end · - to end technical solutions · across multiple technologies for the organisation, through inspirational technical leadership · and visionary long-term thinking. Provide leadership across multiple initiatives guiding ...


  • LexisNexis Johannesburg, South Africa

    If you are passionate about new technologies, innovation-oriented and eager for technical challenges, then join the LexisNexis technical team to build the new generation of legal analytics products. · We operate in human-sized and agile teams to stay in motion, evolve and make ro ...


  • M-KOPA Johannesburg, South Africa

    **We are looking for Software Engineering Team Leads to join both our Retention and Repayments product groups; where progress, and humility are valued as highly as technical excellence.**: · - "Leading a team you will work as a servant leader, coach and contributor within a team ...


  • AdaptIT Johannesburg, South Africa

    **Listing reference**: adapt_000049**Listing status**: Online- · **Position summary** · **Industry**:IT & Internet · - **Job category**:Software-Engineering**Location**:Johannesburg · - **Contract**:Permanent**EE position**:No**About our company** · - A provider of leading specia ...


  • Belmar Personnel Johannesburg, South Africa

    Location : Sandton · - 10 + Years Experience · - JD: · - Hands-on coding experience in Java 8, SpringBoot and Angular · - Jobs core responsibility is to lead from front in Architecting, design and implement scalable next generation system · - Experience in IBM BPM and IBM WPS sui ...


  • Uyandiswa Sandton, South Africa

    **Summary**: · To envision, lead and develop fit for purpose, integrated end · - to end technical solutions across multiple technologies for the organisation, through inspirational technical leadership and visionary long-term thinking. Provide leadership across multiple initiativ ...

  • AMPSTEK

    Lead Test Engineer

    1 day ago


    AMPSTEK Sandton, South Africa

    **Job Title**: Testing Lead (SAP Experience) · **Location**: South Africa · **Key Responsibilities**: · - Lead the testing efforts for SAP projects, including test planning, execution, and reporting. · - Develop comprehensive test strategies and test plans for SAP implementations ...

  • EMPIRE RECRUITMENT

    Lead Engineer

    22 hours ago


    EMPIRE RECRUITMENT Johannesburg, South Africa Full time

    Consulting Engineers with nearly 50 years experience in the industry seeks a Lead Engineer that specialises in water treatment and sanitation. · Key responsibilities: · Head/lead the water/wastewater treatment section within the water and sanitation division · Manage the executi ...

  • Vodafone

    Process Engineer Lead

    22 hours ago


    Vodafone Johannesburg, South Africa

    . · When it comes to putting people first, we're number 1. · The number 1 Top Employer in South Africa. · Certified by the Top Employer Institute 2024. · Role Purpose/Business Unit: · Lead Intelligent Automation Strategy execution · Intimate understanding of maturity of Dat ...

  • SPECD (Pty) Ltd

    Lead Product Engineer

    22 hours ago


    SPECD (Pty) Ltd Johannesburg, South Africa

    · We are currently recruiting for a LEAD PRODUCT ENGINEER for one of our clients in the Banking industry, for a 6-month rolling employment contract. · JOB DESCRIPTION: · Job Title: Lead Product Engineer · Employment Type: 6 Months Contract (Renewable), Hybrid · Work Location: J ...

  • Boldr

    IT Lead Engineer T3

    22 hours ago


    Boldr Johannesburg, South Africa Full time

    A LITTLE BIT ABOUT Boldr · Boldr is the first global B-Corp dedicated to delivering world-class Client experiences while creating access to dignified, meaningful work in communities around the world. · We are a global team, united by our desire to connect diverse people with comm ...


  • SEIGO STAFFING Johannesburg, South Africa Full time

    Must have BSc, BEng or BTech in Mechanical Engineer · Must be registered with ECSA as a Professional or Technologist · Must have 10+ years experience in Infrastructure Projects, Hospitals with all mechanical services · Must have experience with CAD, REVIT and other design technol ...

  • Oxyon People Solutions

    Site Lead Engineer

    22 hours ago


    Oxyon People Solutions Johannesburg, South Africa Full time

    Main functions: · Managing of complete generator project including: · Rebuilding of engines · Positioning of generators · Fuel system · Cable support · Cable installation · Fire prevention system · Technical Support · Site Support · Commissioning · Documentation and handover · Ke ...


  • Slipstream Data Midrand, South Africa

    **Location: Waterfall City, Midrand, Johannesburg** · **Salary: R90K - R120K** · **Start Date: 1 July 2024** · **Hybrid work model - 2 Days per week in office** · Key Responsibilities: · Main objectives for the position: · - Build a competent technical team with the ability to co ...

  • Datonomy Solutions

    Engineering Lead

    22 hours ago


    Datonomy Solutions Johannesburg North, South Africa

    We are looking for an Intermediate Engineering Lead to join our team, based in Johannesburg. · To envision, lead and develop fit for purpose, integrated end- to end technical solutions across multiple technologies for the organisation, through inspirational technical leadership a ...

  • Carry1st

    Lead Security Engineer

    22 hours ago


    Carry1st Johannesburg South, South Africa

    Carry1st is Africa's leading publisher of mobile games and digital content. Operating at the intersection of games, publishing, and fintech, we scale awesome content in frontier markets by solving hard problems. Across our publishing and Pay1st business lines, we are partnered wi ...


  • South Zambezi Engineering Services Centurion, South Africa

    JOB SUMMARY · The incumbent will be required to work closely with HOD and Civil Design Team in the office and those who are assigned to work on projects sites. Closely collaborates with the HOD, executive directors & Project Managers in directing, co-ordinating and exercising fun ...


  • People Source Johannesburg, South Africa

    Able to design, develop, and maintain software applications. An understanding of OOP and N-tier architectures. Lead a team of developers, providing guidance, support, and mentoring to achieve project objectives. Take ownership of a portfolio of products, overseeing development, d ...