Senior Data Engineer- - Sandton, South Africa - Dimension Data

Dimension Data Sandton, South Africa

1 day ago

Description

Functieomschrijving

About Dimension Data

At Dimension Data we empowering our people to deliver client-centric solutions. We want to see our people make the most of every opportunity, and together we can achieve the extraordinary. Our diverse and inspiring people are experts at what they do and serious about delivering measurable and sustainable value at every turn.

Requirements

Extensive understanding and application of Python Development and building complex solutions and applications.
Extensive understanding and application of Python and data processing and transformation
Strong understanding of Microsoft SQL Server and T-SQL Development
Strong Understanding of Code Optimization
Understanding of Real-Time Data Processing and Streaming
Understanding of Apache Beam
Advantageous
Understanding of Apache NiFi and building complex workflows.
Understanding of opensource streaming technologies (Apache Spark Streaming, Flink)
Understanding of Apache Kafka
Understanding of Apache Spark
Understanding of Apache Hadoop
Competency in Python and developing Spark models.
Fundamental understanding of MongoDB
Fundamental understanding of Redis
Fundamental understanding of Databricks
Fundamental understanding and optimization of Linux and cloud environments.

Key Performance Areas:

Effectively conceptualize, design, and create high-quality, custom workflows and analytics solutions.
Develop, test, and implement big data solution designs.
Understand client requirements and establish knowledge of data for accurate design, analysis, and retrieval.
Pull data from various data sources and combine it to store it in a data store for analysis and retrieval.
Collaborating with end users on standardized and best practice approaches.
Making suggestions and enhancements on existing solutions.
Providing regular and timely feedback to clients on design and build status
Educating requestors as to appropriate and desirable parameters to ensure they get the information they need
Ensure all tasks are updated on agile boards in a timely manner
Assist Project Managers and Change and Training Managers with any project and training related administration tasks
Actively Upskill in relevant technologies as prescribed by team leadership
Integration and execution with Machine-learning models and AI in-flow.
Documentation and Design of Solutions

Job Related Experience:

Minimum 4+ years work experience with exposure to data pipeline development and solutions
architecture as well as project management/coordination experience.

Behavioural Competencies:

Good Communication Skills
Good Presentation Skills
Good Adaptability
Must take Initiative
Good at planning and organising
Good at Teamwork
Good at Influencing
Good at Problem Solving
Must have Attention to Detail
Must be good at Analytical Thinking
Must have a desire for Innovation
Must be able to Conceptualise ideas

Qualifications

B Degree – Computer Science / Engineering

Hortonworks Certified

Data Engineer

29 minutes ago

Dimension Data Sandton, South Africa

Functieomschrijving · Standard Bank Anglo is looking for a Data Engineer. This will be strictly remote work. · RequirementsAdvanced knowledge of T24 architecture and Data from a MOD perspective · Analyze and organize raw data · Build data systems and pipelines · Evaluate busin ...
Data Warehouse Engineer

29 minutes ago

Hello Group Recruitment Sandton, South Africa

We are looking for a knowledgeable and experienced Data Warehouse Engineer to monitor and manage the Group's data warehouse, based in Gauteng Centurion. · If you are someone with the required skill set and have a fun-loving demeanour, you will fit in well with our upbeat environ ...
Junior Data Engineer

4 hours ago

Hollard Recruitment Sandton, South Africa

The Junior Data Engineer will report to the Hollard Life Solutions Business Unit area and provide Data Engineering support across all the Business Units within Hollard. · Key Responsibilities: · To ensure effective movement, collection, integration, storage, and provisioning of d ...
Data Engineer X5

16 hours ago

HR Genie Sandton, South Africa

Our Client a Global Tech firm is seeking a Data Engineer to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. · 5 roles to fill - Request for 5 resources 1 X DE required for ECP 2 x DE required for CoDI ...
Intermediate Data Engineer-

31 minutes ago

Dimension Data Sandton, South Africa

Functieomschrijving · Intermediate Data Engineer, Data Processing and Archiving, SQL, Big Data Analytics, Big Data This is a great opportunity to work with an industry leading company in the finance sector. The role will be based at our headquarters in London. The ideal candidate ...
Senior Data Engineer X5

16 hours ago

HR Genie Sandton, South Africa

Our Client a Global Tech firm is seeking a 5 Senior Data Engineers to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. · The Data Engineer skill is required to enable the data lifecycle within EDS, nam ...
Data Modelers X3

2 days ago

HR Genie Sandton, South Africa

Our Client a Global Tech firm is seeking 3 Data Modellers to join their team in Sandton on a contract basis. They offer stability, attractive rates, growth and a great working environment. · The role entails architecting the data platform layer, data cleansing layer, reporting an ...
Esg Information Analyst

2 days ago

Kamo Placements Sandton, South Africa

*** · **Client Engagement**: · - Engage company business partners / stakeholders on the Data and Information Requirements (initially related GHG data requirements) and all other ESG and Sustainability Impact Data requirements · - Engage internal stakeholders on GHG related Data a ...
Specialist Data Scientist

2 days ago

Absa Bank Limited Sandton, South Africa

Bring your possibility to life Define your career with us · - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to rese ...
Esg Information Analyst

2 days ago

Kamo Placement Sandton, South Africa

Gauteng, Sandton · - Annually Cost To Company (Market related, Negotiable) · - Points that provide a holistic explanation of the job · - To collect information from all existing clients relating to Environmental Social & Governance (ESG), with specific focus on Greenhouse Gas (GH ...
Head: Business Analytics

2 days ago

Discovery Ltd. Sandton, South Africa

**Business Unit**:Discovery Bank**Function**:Banking**Date**:16-Jan-2023- Head: Business Analytics**About Discovery** · - Discovery's core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand ...
Solutions Analyst

1 day ago

HR Genie Sandton, South Africa

Our Client a Global tech firm is seeking a Solutions Analyst to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. · **Requirements**: · - Ensure successful implementation and embedment of effective DevO ...
Data Scientist I

3 hours ago

FirstRand Sandton, South Africa

About us, purpose, experience and qualifications · **about us**: · - make a promise · - be deeply invested · - value our differences · - build trust, not territory · - have courage · - always do the right thing · **purpose**: · - To build, optimise and implement innovative quanti ...
BI Specialist

3 hours ago

Adcorp Holdings Sandton, South Africa

**Synopsis** · The **BI Specialist** plays a critical role in shaping and enhancing the overall experience for internal employees. The potential incumbent will partner with business stakeholders to set clear **business KPIs and build dashboards** that provide timely and strategic ...
Data Scientist

1 day ago

Discovery Ltd. Sandton, South Africa

**Business Unit**:Discovery Health**Function**:Application Systems**Date**:15 Nov 2023- Discovery Health · Data Scientist**About Discovery** · - Discovery's core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional indi ...
Geologist

2 days ago

Fides Recrutiemt Sandton, South Africa

**Geology - Engineering** · **Primary Position Purpose** · - Engineering Geology specialist for the site team. · **Key Responsibilities** · - Engineering Geology specialist for the site team, to be full-time in Lesotho during excavation of the Drill and blast and TBM waterway tun ...
Data Scientist

3 hours ago

Discovery Ltd. Sandton, South Africa

**Business Unit**:Discovery Health**Function**:Data Sciences**Date**:8 Jun 2023**DATA SCIENTIST: Risk Intelligence** · **Why you should work at Discovery** · - The role entails making people healthier and protecting and enhancing their lives by leveraging Discovery's vast clinica ...
Data Manager

2 days ago

Pro Personnel Sandton, South Africa

Gauteng, Sandton R 45910 Monthly We are recruiting a Data Manager that will oversee the development and use of data systems in collaboration with the Client's IT Service Provider The incumbent will be required to discover efficient ways to organize, store and analyze data, with s ...
Racf Specialist

3 hours ago

Jai Search Consultancy Sandton, South Africa

**he Role**: · - Systems Management, you will be critical in ensuring the smooth operation of our customers' IT infrastructure. You'll be the mastermind behind maintaining and optimizing their systems, ensuring they're always running at peak performance. · - Not only will you be ...
Product Analyst Graduate

3 hours ago

Experian Sandton, South Africa

Company Description · Experian plc is an Anglo-Irish multinational consumer credit reporting company. · Experian collects and aggregates information on over 1 billion people and businesses, including 235 million individual US consumers and more than 25 million US businesses. · We ...