Jobs
>
Johannesburg

    AWS Cloud Data Engineer - Johannesburg, South Africa - PBT Group

    PBT Group
    PBT Group Johannesburg, South Africa

    1 week ago

    PBT Group background
    Full time
    Description

    PBT Group has an opportunity for an AWS Cloud Data Engineer.

    Duties:

    • Coordinate/Prioritise the work that the Developers and Product Owner
    • Assist with cross-team projects that involve development.
    • AWS practices are followed with sound security and governance.
    • Coordinate with the cloud Center of Excellence team for any AWS account level security and access.
    • Resolve any security findings on your responsible AWS accounts given by group security.
    • Manage the CI/CD pipeline as per architecture approved.
    • Ensure good gates are in place for review for deployment and ensure good practices and patterns are followed in this regard.
    • Code quality will be monitored through peer code reviews.
    • The Quality Assurance Team will conduct exploratory testing to identify defects.
    • Must meet and pass the criteria as specified in the Definition of done as documented on the Feature Team's instance.
    • Strong conceptual understanding of the context and business requirements. Should be able to understand the business needs, High Level design and produce Low level design documents, implement code in accordance with the best practice.
    • Ability to perform data quality checks in a methodical manner to understand how to accurately utilize client data.
    • Expert level programming skills using AWS to meet the challenges of advanced data manipulation, complicated programming logic, and large data volumes is required.
    • Ability to communicate results and methodology with the project team and clients.
    • Ability to meet deadlines and thrive in an insurance environment.
    • Provides solutions for data driven applications involving large and complex data and providing reconciliation and test cases.
    • Understand customer's Business processes and pain areas which need attention.
    • Source system understanding and analysis.
    • Solution Architecture for the entire flow from source to end reporting data marts.
    • Design Conceptual and physical data model for a global Data warehouse in AWS (ETL versus ELT)
    • High Level & Low-Level design for ETL Components in AWS
    • Test prototypes and oversee handover to operational teams.
    • Propose best practices/standards.
    • Build monitoring and testing mechanisms on data transformations.
    • Continuous improvements on AWS in terms of scalability, reliability, and monitoring.
    • Analyse and enhance the architecture of the current implementation.
    • Manage personal delivery on projects and enhancements.
    • Ensure personal service level agreement standards are met.
    • Implement initiatives to improve application performance.
    • Ensure quality of programming code.
    • Translate business requirements into system requirements.
    • Design and document robust, scalable solutions according to set standards.
    • Ensure accuracy of code and adherence to requirements.
    • Ensure all production changes are managed within the release cycle.
    • Participate in the development of key standards.
    • Seek new ways to optimize or innovate as it relates to the use of technology.
    • Ensure personal adherence to agreed governance procedures.
    • Proactively identify and manage risks.
    • Responsible for the design and implementation of effective cross functional business intelligence systems and processes.
    • Analytical with an even mix of business acumen and technical capability.
    • Responsible for working with analysts, managers, and executives to understand business needs and working with source owners to understand the data sources.
    • An innate curiosity and some analytical capability with a passion for learning.
    • Translate business and technical requirements into efficient sustainable solutions.
    • Be able to do gap and impact analysis on the requirement.
    • Accept coaching and mentoring from senior developers/architects.
    • Do QA on designs and development and completed projects as required.
    • Complete documentation of requirements and development according to defined standards.
    • Deliver necessary documentations where require

    Skills and Experience Required:

    • High knowledge in AWS – security groups, permissions, VPC, roles, services.
    • Experience developing engineering applications in corporate companies.
    • Demonstrated project development and leadership skills.
    • Current understanding of best practices regarding system security measures
    • Advanced education and application of business analysis techniques and strategy
    • Experience with software engineering, customer experience and civil engineering preferred.
    • Experience working together with teams from several departments to facilitate the orderly execution of a proposed project plan.
    • Professional experience and a high-level understanding of working with various operating systems and their implications.
    • Professional work experience in team building and project organization.

    Qualifications/ Certification:

    • A degree in Computer Science / Information Systems / Business Administration / Commerce or equivalent
    • Master's degree in Computer Science or Software Engineering is preferred

    * In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By applying for the vacancy via this job ad, you give PBT your consent.

  • Adcorp Holdings

    Data Engineering Lead(Big Data)

    3 days ago

    Adcorp Holdings Johannesburg, South Africa

    **Roles and Responsibilities** Internal Process** · - Responsible for the end-to-end technical solution. This means that key decisions, once discussed and debated, are appropriately understood, and implemented. · - Collaborate with the Product Development Lead and the Business En ...

  • Trafigura

    Data Engineering Graduate

    1 week ago

    Trafigura Johannesburg, South Africa

    -Trafigura · Johannesburg, South Africa · Posted 5 hours ago Permanent Competitive · **Main Purpose**: · We are looking to hire a motivated, enthusiastic and skilled graduate to join our Data Engineering team, based in Johannesburg and reporting directly to our Global Data Engine ...

  • Trafigura

    Data Engineering Graduate

    3 days ago

    Trafigura Johannesburg, South Africa

    **Main Purpose**:We are looking to hire a motivated, enthusiastic and skilled graduate to join our Data Engineering team, based in Johannesburg and reporting directly to our Global Data Engineering Manager. · You will be given the opportunity to expand your skills in a data-rich ...

  • FirstRand

    Data Engineer-1

    1 week ago

    FirstRand Johannesburg, South Africa

    Job Description · To ensure effective movement, collection, integration, storage and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such as Enterprise Architecture, ...

  • THE SKILLS MINE (PTY) LTD

    Data Engineering Specialist

    5 days ago

    THE SKILLS MINE (PTY) LTD Johannesburg, South Africa

    **Requirements**: · - BS degree, preferably in Information Technology, Management Information Systems, Computer Science, or · similar discipline, Master's Degree · - 8-10 years' experience developing and maintaining data architecture aligned to · best practice data warehouse desi ...

  • Megan Förg Consulting

    Data Engineering Technical Lead

    1 week ago

    Megan Förg Consulting Johannesburg, South Africa

    **About the Role**: · **Requirements**: · 5+ years data engineering technical experience · Technical skills to include as many of the following: · Data Modelling (e.g. Kimball/Data Vault) · Scripting/coding (e.g Python, T-SQL, SQL, Spark, PySpark,) · ETL/ELT (Eg. Alteryx, SSIS, d ...

  • Megan Frg Consulting

    Data Engineering Technical Lead

    1 week ago

    Megan Frg Consulting Johannesburg, South Africa

    **Location**: Sandton, Johannesburg · **Salary**: Highly Negotiable · **About the Role**: · **Requirements**: · 5+ years data engineering technical experience · **Technical skills to include as many of the following**: · Data Modelling (e.g. Kimball/Data Vault) · Scripting/coding ...

  • Inisys

    Document Controller/engineering Data Processor

    1 week ago

    Inisys Johannesburg, South Africa

    **Mandatory**: · - Must be competent in Excel at least or any other database type program like MS Access, Power BI, SAP. · - Must be able to provide a solution to a problem regarding the data he/she is entering into the database or spreadsheet. · - Be able to be on site at Mozal ...

  • Discovery Ltd.

    Data Engineering Specialist

    3 days ago

    Discovery Ltd. Sandton, South Africa

    **Business Unit**:Discovery Central Services**Function**:Data Sciences**Date**:24 May 2023- Discovery People- Data Engineering Specialist - DP Analytics**About Discovery** · - Discovery's core purpose is to make people healthier and to enhance and protect their lives. We seek out ...

  • E-Merge

    Data Engineer

    1 day ago

    E-Merge Johannesburg, South Africa

    Join a long serving bank and financial services group, committed to providing banking, insurance and asset management services. This bank is counted as Africa''s biggest lender by assets and they are looking for a Data Engineer to execute data engineering duties according to the ...

  • Puma Energy

    Data Engineer

    1 week ago

    Puma Energy Johannesburg, South Africa Full time

    Main Purpose: · Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. · Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists t ...

  • E-Merge

    Data Engineer

    1 day ago

    E-Merge Johannesburg, South Africa

    A Group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data wa ...

  • NTT DATA

    Data Engineer

    3 days ago

    NTT DATA Johannesburg, South Africa

    Job Description · NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • Mimecast

    Data Engineer

    4 days ago

    Mimecast Johannesburg, South Africa Full time

    Analytics Engineer · We're your dream business intelligence team · The Business Intelligence & Analytics team at Mimecast is an exciting blend of business, data, and technology. Using a high-powered technology stack that includes Tableau, dbt, Cloud & On-prem Data Warehouse and ...

  • Progressive Edge

    Data Engineer

    1 day ago

    Progressive Edge Johannesburg, South Africa

    Data Engineer & Analyst (Spatial Data) · Johannesburg · Permanent · An entrepreneurial, and forward-thinking company specialises in utilizing geospatial data and technologies to help clients enhance their operational efficiencies and increase profitability. They offer tailo ...

  • Deka Minas Pty Ltd

    Data Engineer

    1 day ago

    Deka Minas Pty Ltd Johannesburg, South Africa Contract

    We are hiring a talented Data Engineer professional to join our team. If you're excited to be part of a winning team, this is a great place to grow your career. · Requires experience in: · Terradata · PowerBI · MSSQL · Hive · Ab Initio (a bonus) · Data API's · Will be required t ...

  • Psybergate

    Data Engineer

    1 day ago

    Psybergate Johannesburg, South Africa

    What you will be doing / What we are looking for: Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between source system (golden/trusted) and the target database (LOB), hence provide good quality data by applying the ne ...

  • Network Recruitment

    Data Engineer

    5 days ago

    Network Recruitment Johannesburg, South Africa

    Our client, a leading company within the Financial Services industry, is seeking a highly skilled Senior Data Engineer to join their dynamic team. In this role, you will play a critical part in designing, developing, and maintaining robust data pipelines, ensuring the availabilit ...

  • NTT DATA

    Data Engineer

    1 week ago

    NTT DATA Johannesburg, South Africa

    Job Description · NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • NTT

    Data Engineer

    1 week ago

    NTT Johannesburg, South Africa Full time

    JOB DESCRIPTION NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...