Jobs
>
Johannesburg

    Data Engineer - Johannesburg, South Africa - NTT

    NTT
    NTT Johannesburg, South Africa

    1 week ago

    ntt background
    Full time
    Description

    NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future.

    In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented people, world-class technology partners and emerging innovators, we help our clients solve some of the world's most significant technological, business and societal challenges.

    With people at the heart of our success, NTT is committed to attracting and growing the best talent and providing an environment where everyone feels they can belong and their contribution matters.

    Want to be a part of our team?

    The Data Engineer is responsible for the transformation of data into a structured format that can be easily analysed in a query or report. The role is responsible for developing structured data sets that can be reused or compliment other data sets and reports. The individual analyses the data sources and data structure and will design and develop data models to support the analytics requirements of the business which includes management / operational / predictive / data science capabilities.

    Working at NTT

    Data Engineering

    • The key responsibilities of an Azure data engineer include designing and implementing data storage solutions
    • Building and maintaining data pipelines, ensuring data quality and accuracy, optimizing data processing performance, developing, and maintaining data models and schemas,
    • Collaborating with other teams to provide data for analytics and reporting, and ensuring compliance with data security & privacy regulations.

    Designing and implementing data storage solutions on Azure

    • The data engineer is to design and implement data storage solutions on Azure. That includes selecting the appropriate Azure data storage services for the specific use case, such as Azure SQL Database, Azure Cosmos DB.

    Building and maintaining data pipelines for data integration and processing

    • Build and maintain data pipelines for data integration and processing. Accordingly, data is collected from various sources structured and unstructured data, files into blob storage.
    • The data is transformed into a practical format and loaded into the appropriate data storage solution on Azure using tools such as Azure Data Factory.
    • Ensure data is pushed in to SQL tables views, measures and relationship are manged in these tables.
    • Must also ensure the data pipeline is scalable and efficient.

    Ensuring data quality and accuracy through testing and validation

    • Data quality and accuracy are critical to the success of any data management system.
    • As a data engineer, you must ensure that the data stored and processed and is highly accurate. It involves testing and verifying the data at different phases of the data pipeline, from extraction through loading.

    Optimizing data processing performance through tuning and monitoring:

    • Data processing performance is another critical aspect of data engineering.
    • The data engineer must ensure the data processing is efficient and scalable by tuning the data pipeline and monitoring performance.
    • That involves identifying and resolving bottlenecks in the data pipeline and optimising the data processing algorithms.

    Developing and maintaining data models and schemas:

    • Data modelling and schema design are important aspects of data engineering.
    • The data engineer must develop and maintain data models and schemas optimized for the specific use case. That involves selecting the appropriate data modelling techniques and ensuring the data schema is scalable and efficient.

    Collaborating with other teams to provide data for analytics and reporting:

    • As a data engineer, you will work closely with other teams, such as data analysts, data scientists, and software developers, to provide the data they need to perform their job functions.
    • That involves understanding the specific data requirements of each team and ensuring that the data is available in the appropriate format.

    Ensuring data security and privacy prerequisites are followed:

    • The security and privacy of knowledge are important elements of any information management system.
    • The data engineer oversees ensuring that the data stored and processed on Azure conforms with applicable data security and privacy requirements, such as POPIA and GDPR.

    Technologies :

    • SQL, Apache Spark, Azure Blob Storage, Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Azure Event Hubs, Azure Pipelines, Azure Repos, Azure SQL Database, Azure Stream Analytics, Azure Synapse Analytics, Microsoft Azure, Microsoft Power BI, PySpark, Python etc.

    Skills Summary

    Big Data Solutions, Business Analysis, Data Analysis, Data Analytics, DATABASICS, Data Lake, Data Modeling, Unstructured Data

    What will make you a good fit for the role?

    Workplace type:

    Hybrid Working

    Equal Opportunity Employer

    NTT is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, color, sex, religion, national origin, disability, pregnancy, marital status, sexual orientation, gender reassignment, veteran status, or other protected category

    Join our growing global team and accelerate your career with us. Apply today.

    A career at NTT means:

    • Being part of a global pioneer – where you gain exposure to our Fortune 500 clients and world-leading global technology partners and work with a network of over 40,000 smart and diverse colleagues across 57 countries, delivering services in over 200 countries.
    • Being at the forefront of cutting-edge technology – backed with a 150-year heritage of using technology for good. With 40% of the world's internet traffic running on our network and where Emoji were first invented, you can be proud of the group's many new 'firsts'.
    • Making a difference – by doing meaningful work that helps to shape the future for our clients, and across industries and communities around the world.
    • Being your best self – in a progressive 'Connected Working' environment that promotes flexibility, connection and wellbeing. Where diversity and different perspectives are embraced to ensure equal opportunities for all.
    • Having ongoing opportunities to own and develop your career – with a personal and professional development plan and access to the broadest learning offerings in the industry.
  • Adcorp Holdings

    Data Engineering Lead(Big Data)

    1 day ago

    Adcorp Holdings Johannesburg, South Africa

    **Roles and Responsibilities** Internal Process** · - Responsible for the end-to-end technical solution. This means that key decisions, once discussed and debated, are appropriately understood, and implemented. · - Collaborate with the Product Development Lead and the Business En ...

  • THE SKILLS MINE (PTY) LTD

    Data Engineering Specialist

    3 days ago

    THE SKILLS MINE (PTY) LTD Johannesburg, South Africa

    **Requirements**: · - BS degree, preferably in Information Technology, Management Information Systems, Computer Science, or · similar discipline, Master's Degree · - 8-10 years' experience developing and maintaining data architecture aligned to · best practice data warehouse desi ...

  • Trafigura

    Data Engineering Graduate

    1 day ago

    Trafigura Johannesburg, South Africa

    **Main Purpose**:We are looking to hire a motivated, enthusiastic and skilled graduate to join our Data Engineering team, based in Johannesburg and reporting directly to our Global Data Engineering Manager. · You will be given the opportunity to expand your skills in a data-rich ...

  • Trafigura

    Data Engineering Graduate

    6 days ago

    Trafigura Johannesburg, South Africa

    -Trafigura · Johannesburg, South Africa · Posted 5 hours ago Permanent Competitive · **Main Purpose**: · We are looking to hire a motivated, enthusiastic and skilled graduate to join our Data Engineering team, based in Johannesburg and reporting directly to our Global Data Engine ...

  • FirstRand

    Data Engineer-1

    5 days ago

    FirstRand Johannesburg, South Africa

    Job Description · To ensure effective movement, collection, integration, storage and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such as Enterprise Architecture, ...

  • Megan Frg Consulting

    Data Engineering Technical Lead

    5 days ago

    Megan Frg Consulting Johannesburg, South Africa

    **Location**: Sandton, Johannesburg · **Salary**: Highly Negotiable · **About the Role**: · **Requirements**: · 5+ years data engineering technical experience · **Technical skills to include as many of the following**: · Data Modelling (e.g. Kimball/Data Vault) · Scripting/coding ...

  • Megan Förg Consulting

    Data Engineering Technical Lead

    5 days ago

    Megan Förg Consulting Johannesburg, South Africa

    **About the Role**: · **Requirements**: · 5+ years data engineering technical experience · Technical skills to include as many of the following: · Data Modelling (e.g. Kimball/Data Vault) · Scripting/coding (e.g Python, T-SQL, SQL, Spark, PySpark,) · ETL/ELT (Eg. Alteryx, SSIS, d ...

  • Inisys

    Document Controller/engineering Data Processor

    1 week ago

    Inisys Johannesburg, South Africa

    **Mandatory**: · - Must be competent in Excel at least or any other database type program like MS Access, Power BI, SAP. · - Must be able to provide a solution to a problem regarding the data he/she is entering into the database or spreadsheet. · - Be able to be on site at Mozal ...

  • Discovery Ltd.

    Data Engineering Specialist

    1 day ago

    Discovery Ltd. Sandton, South Africa

    **Business Unit**:Discovery Central Services**Function**:Data Sciences**Date**:24 May 2023- Discovery People- Data Engineering Specialist - DP Analytics**About Discovery** · - Discovery's core purpose is to make people healthier and to enhance and protect their lives. We seek out ...

  • NTT DATA

    Data Engineer

    1 day ago

    NTT DATA Johannesburg, South Africa

    Job Description · NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • Network Recruitment

    Data Engineer

    3 days ago

    Network Recruitment Johannesburg, South Africa

    Our client, a leading company within the Financial Services industry, is seeking a highly skilled Senior Data Engineer to join their dynamic team. In this role, you will play a critical part in designing, developing, and maintaining robust data pipelines, ensuring the availabilit ...

  • E-Merge

    Data Engineer

    5 days ago

    E-Merge Johannesburg, South Africa

    Join a long serving bank and financial services group, committed to providing banking, insurance and asset management services. This bank is counted as Africa''s biggest lender by assets and they are looking for a Data Engineer to execute data engineering duties according to the ...

  • IT Ridge Technologies

    Data Engineering

    5 days ago

    IT Ridge Technologies Johannesburg, South Africa Full time

    As a Data Engineering & Analytics vertical market lead you will be responsible for providing advisory and thought leadership on the provision of analytics environments leveraging Cloud based platforms, big data technologies, including integration with existing data and analytics ...

  • E-Merge

    Data Engineer

    5 days ago

    E-Merge Johannesburg, South Africa

    A Group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL systems for a big data war ...

  • Mimecast

    Data Engineer

    2 days ago

    Mimecast Johannesburg, South Africa Full time

    Analytics Engineer · We're your dream business intelligence team · The Business Intelligence & Analytics team at Mimecast is an exciting blend of business, data, and technology. Using a high-powered technology stack that includes Tableau, dbt, Cloud & On-prem Data Warehouse and ...

  • Puma Energy

    Data Engineer

    5 days ago

    Puma Energy Johannesburg, South Africa Full time

    Main Purpose: · Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake. · Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists t ...

  • Progressive Edge

    Data Engineer

    4 days ago

    Progressive Edge Johannesburg, South Africa

    Data Engineer & Analyst (Spatial Data) · Johannesburg · Permanent · An entrepreneurial, and forward-thinking company specialises in utilizing geospatial data and technologies to help clients enhance their operational efficiencies and increase profitability. They offer tailored da ...

  • NTT DATA

    Data Engineer

    5 days ago

    NTT DATA Johannesburg, South Africa

    Job Description · NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • NTT

    Data Engineer

    5 days ago

    NTT Johannesburg, South Africa Full time

    JOB DESCRIPTION NTT is a leading global IT solutions and services organisation that brings together people, data and things to create a better and more sustainable future. · In today's 'iNTTerconnected' world, connections matter more now than ever. By bringing together talented ...

  • Deka Minas (Pty) Ltd

    Data Engineer

    5 days ago

    Deka Minas (Pty) Ltd Johannesburg, South Africa Contract

    We are hiring a talented Data Engineer professional to join our team. If you're excited to be part of a winning team, this is a great place to grow your career. · Requires experience in: · Terradata · PowerBI · MSSQL · Hive · Ab Initio (a bonus) · Data API's · Will be required t ...