Data Engineer - Sandton - Profession Hub

    Profession Hub
    Profession Hub Sandton

    4 days ago

    Profession Hub background
    Description

    Job Description

    Role Overview: We are seeking a highly skilled and experienced Data Engineer to join our team.

    The ideal candidate will have 3 to 5 years of professional experience as a Data Engineer or related role, with a strong foundation in computer science, software engineering, or a related field.

    • Required Minimum Education / Training:
    • Bachelor's degree in computer science, software engineering, informatics, or information systems.
    • A degree from an accredited institution is essential to ensure foundational knowledge in programming, algorithms, and software design.
    • Equivalent qualifications or certifications combined with significant industry experience may also be considered.
    • Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate, Power BI Data Analyst, MCSA/MCSE SQL Server 2012/2014) are a plus.
    • Required Minimum Work Experience:
    • 3-5 Years of professional experience

    Technical Competencies:

    • AirFlow, etc. or At least 3 years of experience working with Microsoft SQL Server, Sybase, or Postgres SQL.
    • Familiarity with NoSQL DB systems.
    • Strong t-SQL knowledge.
    • Intermediate Python development and familiarity with data-related libraries (Pandas, PySpark, Numpy, etc.)
    • Working with ETL/ELT tools such as SSIS, Data Factory, Synapse, and similar tools for AWS (e.g., Glue, Fire Hose).
    • SQL Internals – statistics, execution plans, wait types, isolation levels, DMVs, indexes.
    • Understanding of Hadoop, Spark, Map Reduce, columnar databases, and Massive Parallel Processing systems.
    • Setting up data ingestion processes in either Azure, AWS, or GCP.
    • Experience with Visualisation tools such as Power BI, SSRS, Tableau, or QlikView.
    • Experience with SQL Server and database design, requiring at least 3-5 years' experience.
    • Knowledge of writing and optimizing complex queries with 3-5 years of expertise.
    • Version Control and CI/CD:
    • Proficient in using Git and working with repositories like GitHub or Bitbucket, with a minimum of 3-5 years of experience.
    • Familiarity with CI/CD pipelines and deployment strategies with 3-5 years of experience.

    Behavioural Competencies:

    • Problem Solving: Demonstrated ability to tackle complex problems and devise effective solutions.
    • Communication: Strong ability to communicate technical details clearly to both technical and non-technical stakeholders.
    • Team Collaboration: Proven experience working effectively both as part of a team and independently.
    • Innovative Thinking: Capacity to bring creative solutions to technical challenges.
    • Leadership: Ability to guide and mentor junior team members, leading by example and fostering a positive team environment.
    • Accountability: take ownership and accountability of tasks assigned to you

    Key Performance Areas:

    • Maintain and Enhance Existing Systems:
      • Identify and resolve issues in existing software systems.
      • Perform system upgrades and ensure compatibility with new technologies.
    • Design and Develop New Features:
      • Collaborate with stakeholders to gather requirements.
      • Implement new features and functionalities in both front-end and back-end systems.
    • Innovate and Optimize:
      • Explore new tools and technologies to enhance system performance and scalability.
      • Propose and implement improvements to existing workflows and processes.
    • Collaborate with Team Members:
      • Work closely with developers, QA, and product managers to deliver high-quality solutions.
      • Participate in code reviews and share best practices.

  • Boardroom Appointments

    Data Engineer

    1 day ago


    Boardroom Appointments Sandton

    Data Engineer - 12 Month Contract · Key Responsibilities: · Design, build, and maintain scalable data pipelines. · Develop ETL processes to extract, transform, and load data from various sources. · Data Integration and Management · Integrate data from multiple sources to create a ...

  • DeARX

    Data Engineer

    16 hours ago


    DeARX Sandton

    We are seeking a highly skilled Data Engineer with 3-5 years of experience for a 12-month contract. · The successful candidate will have a strong background in data engineering, analytics, and business intelligence, with expertise in: · Power BI · Python · SQL · QlikView · Hadoop ...

  • Datonomy Solutions

    Data Engineer

    4 days ago


    Datonomy Solutions Sandton

    We are seeking Data Engineers to help build our data infrastructure at our company. · The ideal candidate will have extensive experience in data engineering, particularly with SAS, SQL, and Azure Cloud Stack, and will be responsible for designing, developing, and maintaining the ...


  • Datacentrix Sandton

    Senior Data Engineer · The Role of a Senior Data Engineer at Managed Talents Solutions involves leading the design, build, and implementation of data and analytics products and solutions for various stakeholders to facilitate our journey towards becoming an insights-led organisat ...


  • Datacentrix Sandton

    Senior Data Engineer · We are seeking a highly experienced Senior Data Engineer to join our team. The successful candidate will design, build and implement data and analytics products and solutions for various stakeholders, enabling us to become an insights-led organization. · Th ...


  • Tech Sight (Pty) Ltd Sandton

    About the Role: · We are seeking a highly skilled Principal Ab Initio Data Engineer to join our technologically advanced bank. · Key Responsibilities: · Advanced Data Engineering: Design, build, and maintain scalable Ab Initio data pipelines and ETL processes that automate action ...


  • ProDevelopment Group Sandton

    Job Title: Data Engineer · We are seeking a skilled Data Engineer to join our team at Lumos in Sandton. · Location: Gauteng, Johannesburg Metro · Job Type: Contract · Duration: 12 months · Key Responsibilities: · Design and implement data solutions that meet business requirements ...


  • Capitec Bank Sandton

    Job Description · We are seeking a highly motivated and experienced Manager: Analytics Engineering to join our team. This individual will play a pivotal role in designing and managing scalable data pipelines and ensuring efficient analytics operations to empower data-driven decis ...


  • Muse Consultancy Services Sandton

    Sandton, South Africa | Posted on 08/28/2024 · MUSE is a consulting company, specialising in resourcing, recruitment and outsourcing of software development teams. · MUSE was founded and is run by experienced developers who are passionate about technology and innovation. We have ...


  • Capitec Bank Ltd. Sandton

    Manager: Data and Analytics (Analytics Engineering) · We're on the lookout for energetic, self-motivated individuals who share our passion for service in the banking industry. To be part of the journey, follow the steps below: · To see what life at Capitec is all about and comple ...


  • Hire Resolve Sandton

    Credit Data Analyst Position · As a leading FinTech company, we are seeking an experienced Credit Data Analyst to contribute to our team. The successful candidate will be responsible for analyzing credit data to assess risk and provide valuable insights that inform business decis ...


  • Hire Resolve Sandton

    Credit Data Analyst · Hire Resolve, an emerging FinTech company, is seeking a skilled Credit Data Analyst to support their growth. This role involves analyzing credit data to assess risk and provide insights that drive business decisions. · Responsibilities: · Optimize performanc ...


  • IT Notion Sandton

    Key Responsibilities · Create value for internal and external clients by collaborating with them to ask strategic business questions, applying advanced analytical methods to provide data-driven insights. · Duties & Accountabilities · Main Objectives: · ● Engage with business stak ...


  • AB InBev Africa Sandton

    Transform your career by driving significant impact in data science across Africa. We seek a visionary Principal Data Architect to shape our organization's data infrastructure. · Key Responsibilities · Data Roadmap Development: Collaborate with stakeholders to define a comprehens ...


  • Boardroom Appointments Sandton

    Process Engineer III [12 Month Contract] · A Process Engineer III will drive strategic and tactical aspects of business process improvement, focusing on complex outcomes using technical expertise. · Responsibilities: · Discover and validate business-process-related knowledge, doc ...


  • Cortez Trading (Pty) Ltd Sandton

    Credit Data Analyst · The role involves working with large volumes of data, leveraging strong analytical capabilities to drive business decisions. · Key Responsibilities: · Measure and manage performance across multiple credit products. · Evaluate and improve business decisions w ...


  • Hire Resolve Sandton

    Job Description · About the Role · We are seeking a highly skilled Group Engineering Manager to join our team at {company}. The successful candidate will be responsible for providing engineering technical support and overseeing project management, design, and construction across ...


  • LZ Security & Service GmbH Sandton

    A Security Engineer is a crucial member of an organization's IT team, specializing in safeguarding digital assets and maintaining the security posture of the company. They work to design, implement, and manage security measures to protect against cyber threats, unauthorized acces ...

  • Discovery Limited

    Talent Pool

    4 days ago


    Discovery Limited Sandton

    Senior Data Scientist · The Discovery Group's Data Science Lab is a highly specialized and expanding team that tackles challenges in the health, life, and short-term insurance businesses. · We are looking for individuals with 2-5 years of experience to work on projects related to ...

  • Nedbank Head Office

    BI Data Analyst

    15 hours ago


    Nedbank Head Office Sandton

    Job Purpose · To support and maintain the data warehouse in line with the data model and metadata repository, provide business intelligence analysis, and create interactive and dynamic visualizations to communicate complex data insights to stakeholders. · Key Responsibilities · D ...

Jobs
>
Data engineer