Jobs
>
Johannesburg

    AWS Data Engineer - Johannesburg, South Africa - E-Merge

    E-Merge
    E-Merge Johannesburg, South Africa

    3 days ago

    E-Merge background
    Description

    An information technology and business consulting company that provides highly specialised solutions to large and small enterprises in both the private and public sectors seeks a highly motivated and experienced AWS Data Engineer to join their Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business. The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS Glue Spark.

    Responsibilities:

    • Creating data models that can be used to extract information from various sources
    • Lead the design, implementation, and successful delivery of large-scale, critical, or

    difficult data solutions involving a significant amount of data

    • Utilise expertise in SQL and have a strong understanding of ETL and data modelling
    • Ability to ingest data into AWS S3, perform ETL into RDS or Redshift
    • Use AWS Lambda (C# or Python) for event-driven data transformations
    • Designing and implementing security measures to protect data from unauthorized

    access or misuse

    • Maintaining the integrity of data by designing backup and recovery procedures
    • Work on automating the migration process in AWS from development to production

    Experience and Qualifications:

    • Bachelor''s degree in Computer Science, Information Systems, or related field.
    • AWS Certified Machine Learning Specialty Certificate
    • Must have experience with AWS Glue Jobs using PySpark or AWS Glue Spark
    • 5 Years Python/C# Development
    • 3 Years AWS Data Engineering
    • Strong SQL and C# or Python programming knowledge
    • Objective oriented principles in C# or Python
    • AWS technical certifications (Developer Associate or Solutions Architect)
    • services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM)
    • Experience working with RDBMS databases, such as Postgres, SQL Server

    The Reference Number for this position is NG58761 which is a Permanent Hybrid position based in Johannesburg offering a cost to company salary negotiable from R500k to R650k Per Annum based experience and ability. Contact Nokuthula at

  • Trafigura

    Data Engineering Graduate

    4 days ago

    Trafigura Johannesburg, South Africa

    -Trafigura · Johannesburg, South Africa · Posted 5 hours ago Permanent Competitive · **Main Purpose**: · We are looking to hire a motivated, enthusiastic and skilled graduate to join our Data Engineering team, based in Johannesburg and reporting directly to our Global Data Engine ...

  • FirstRand

    Data Engineer-1

    3 days ago

    FirstRand Johannesburg, South Africa

    Job Description · To ensure effective movement, collection, integration, storage and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such as Enterprise Architecture, ...

  • THE SKILLS MINE (PTY) LTD

    Data Engineering Specialist

    1 day ago

    THE SKILLS MINE (PTY) LTD Johannesburg, South Africa

    **Requirements**: · - BS degree, preferably in Information Technology, Management Information Systems, Computer Science, or · similar discipline, Master's Degree · - 8-10 years' experience developing and maintaining data architecture aligned to · best practice data warehouse desi ...

  • Megan Förg Consulting

    Data Engineering Technical Lead

    3 days ago

    Megan Förg Consulting Johannesburg, South Africa

    **About the Role**: · **Requirements**: · 5+ years data engineering technical experience · Technical skills to include as many of the following: · Data Modelling (e.g. Kimball/Data Vault) · Scripting/coding (e.g Python, T-SQL, SQL, Spark, PySpark,) · ETL/ELT (Eg. Alteryx, SSIS, d ...

  • Megan Frg Consulting

    Data Engineering Technical Lead

    3 days ago

    Megan Frg Consulting Johannesburg, South Africa

    **Location**: Sandton, Johannesburg · **Salary**: Highly Negotiable · **About the Role**: · **Requirements**: · 5+ years data engineering technical experience · **Technical skills to include as many of the following**: · Data Modelling (e.g. Kimball/Data Vault) · Scripting/coding ...

  • Inisys

    Document Controller/engineering Data Processor

    5 days ago

    Inisys Johannesburg, South Africa

    **Mandatory**: · - Must be competent in Excel at least or any other database type program like MS Access, Power BI, SAP. · - Must be able to provide a solution to a problem regarding the data he/she is entering into the database or spreadsheet. · - Be able to be on site at Mozal ...

  • E-Merge

    Data Engineer

    3 days ago

    E-Merge Johannesburg, South Africa

    Join a long serving bank and financial services group, committed to providing banking, insurance and asset management services. This bank is counted as Africa''s biggest lender by assets and they are looking for a Data Engineer to execute data engineering duties according to the ...

  • NTT DATA

    Data Engineer

    3 days ago

    NTT DATA Johannesburg, South Africa

    Job Description · NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • NTT

    Data Engineer

    3 days ago

    NTT Johannesburg, South Africa Full time

    JOB DESCRIPTION NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • Puma Energy

    Data Engineer

    3 days ago

    Puma Energy Johannesburg, South Africa Full time

    Main Purpose: · Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. · Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists t ...

  • NTT DATA

    Data Engineer

    1 week ago

    NTT DATA Johannesburg, South Africa

    Job Description · NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • NTT

    Data Engineer

    6 days ago

    NTT Johannesburg, South Africa Full time

    NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-cla ...

  • Progressive Edge

    Data Engineer

    2 days ago

    Progressive Edge Johannesburg, South Africa

    Data Engineer & Analyst (Spatial Data) · Johannesburg · Permanent · An entrepreneurial, and forward-thinking company specialises in utilizing geospatial data and technologies to help clients enhance their operational efficiencies and increase profitability. They offer tailored da ...

  • E-Merge

    Data Engineer

    3 days ago

    E-Merge Johannesburg, South Africa

    A Group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data war ...

  • Deka Minas (Pty) Ltd

    Data Engineer

    3 days ago

    Deka Minas (Pty) Ltd Johannesburg, South Africa Contract

    We are hiring a talented Data Engineer professional to join our team. If you're excited to be part of a winning team, this is a great place to grow your career. · Requires experience in: · Terradata · PowerBI · MSSQL · Hive · Ab Initio (a bonus) · Data API's · Will be required t ...

  • Mimecast

    Data Engineer

    4 hours ago

    Mimecast Johannesburg, South Africa Full time

    Analytics Engineer · We're your dream business intelligence team · The Business Intelligence & Analytics team at Mimecast is an exciting blend of business, data, and technology. Using a high-powered technology stack that includes Tableau, dbt, Cloud & On-prem Data Warehouse and ...

  • Network Recruitment

    Data Engineer

    20 hours ago

    Network Recruitment Johannesburg, South Africa

    Our client, a leading company within the Financial Services industry, is seeking a highly skilled Senior Data Engineer to join their dynamic team. In this role, you will play a critical part in designing, developing, and maintaining robust data pipelines, ensuring the availabilit ...

  • NTT

    Data Engineer

    1 week ago

    NTT Johannesburg, South Africa Full time

    NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-cla ...

  • IT Ridge Technologies

    Data Engineering

    3 days ago

    IT Ridge Technologies Johannesburg, South Africa Full time

    As a Data Engineering & Analytics vertical market lead you will be responsible for providing advisory and thought leadership on the provision of analytics environments leveraging Cloud based platforms, big data technologies, including integration with existing data and analytics ...

  • PRR Recruitment Services

    Data Engineer

    3 days ago

    PRR Recruitment Services Johannesburg, South Africa Full time

    This well known company is looking for a Data Engineer. will be based in Rivonia · The ideal candidate will have strong experience in the following: · Data cleaning · SQL Export · Big data Sets · BSc Degree in Maths and Stats will be required · a min of 3 years experience. ...