Jobs

    Intermediate Data Engineer- - Sandton, South Africa - Dimension Data

    Dimension Data
    Dimension Data Sandton, South Africa

    2 days ago

    dimension data background
    Description
    Functieomschrijving

    Intermediate Data Engineer, Data Processing and Archiving, SQL, Big Data Analytics, Big Data This is a great opportunity to work with an industry leading company in the finance sector. The role will be based at our headquarters in London. The ideal candidate will have strong experience of working on large scale data processing projects within the financial services sector. You'll need to be comfortable using Python and Java programming languages for both developing new products as well as supporting existing ones through enhancements or upgrades. Experience of MongoDB is also desirable but not essential. You should ideally have gained substantial experience building scalable solutions that leverage Apache Hadoop & Spark technology for managing massive volumes of data across different platforms (e.g., AWS). This includes your own original

    Requirements

    • Extensive understanding and application of Python Development and building complex solutions and applications.
    • Extensive understanding and application of Python and data processing and transformation
    • Strong understanding of Microsoft SQL Server and T-SQL Development
    • Strong Understanding of Code Optimization
    • Understanding of Real-Time Data Processing and Streaming
    • Understanding of Apache Beam
    • Advantageous
    • Understanding of Apache NiFi and building complex workflows.
    • Understanding of opensource streaming technologies (Apache Spark Streaming, Flink)
    • Understanding of Apache Kafka
    • Understanding of Apache Spark
    • Understanding of Apache Hadoop
    • Competency in Python and developing Spark models.
    • Fundamental understanding of MongoDB
    • Fundamental understanding of Redis
    • Fundamental understanding of Databricks

    Fundamental understanding and optimisation of Linux and cloud environments.

    Key Performance Areas:

    • Effectively conceptualise, design and create high quality, custom workflows and analytics solutions.
    • Develop, test, and implement big data solution designs.
    • Understand client requirements and establish knowledge of data for accurate design, analysis and
    • retrieval.
    • Pull data from various data sources and combine it to store it in a datastore for analysis and
    • retrieval.
    • Collaborating with end users on standardized and best practice approaches.
    • Making suggestions and enhancements on existing solutions.
    • Providing regular and timely feedback to clients on design and build status
    • Educating requestors as to appropriate and desirable parameters to ensure they get the information
    • they need
    • Ensure all tasks are updated on agile boards in a timely manner
    • Assist Project Managers and Change and Training Managers with any project and training related
    • administration tasks
    • Actively Upskill in relevant technologies as prescribed by team leadership
    • Integration and execution with Machine-learning models and AI in-flow.
    • Documentation and Design of Solutions

    Job Related Experience:

    • Minimum 4+ years work experience with exposure to data pipeline development and solutions
    • architecture as well as project management/coordination experience.

    Behavioural Competencies:

    • Good Communication Skills
    • Good Presentation Skills
    • Good Adaptability
    • Must take Initiative
    • Good at Planning and organising
    • Good at Teamwork
    • Good at Influencing
    • Good at Problem Solving
    • Must have Attention to Detail
    • Must be good at Analytical Thinking
    • Must have a desire for Innovation
    • Must be able to Conceptualise ideas

    Qualifications

    B Degree – Computer Science / Engineering

    Hortonworks Certified

  • Dimension Data

    Data Engineer

    2 days ago

    Dimension Data Sandton, South Africa

    Functieomschrijving · Standard Bank Anglo is looking for a Data Engineer. This will be strictly remote work. · RequirementsAdvanced knowledge of T24 architecture and Data from a MOD perspective · Analyze and organize raw data · Build data systems and pipelines · Evaluate busin ...

  • HR Genie

    Data Engineer X5

    3 days ago

    HR Genie Sandton, South Africa

    Our Client a Global Tech firm is seeking a Data Engineer to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. · 5 roles to fill - Request for 5 resources 1 X DE required for ECP 2 x DE required for CoDI ...

  • Hollard Recruitment

    Junior Data Engineer

    2 days ago

    Hollard Recruitment Sandton, South Africa

    The Junior Data Engineer will report to the Hollard Life Solutions Business Unit area and provide Data Engineering support across all the Business Units within Hollard. · Key Responsibilities: · To ensure effective movement, collection, integration, storage, and provisioning of d ...

  • Hello Group Recruitment

    Data Warehouse Engineer

    2 days ago

    Hello Group Recruitment Sandton, South Africa

    We are looking for a knowledgeable and experienced Data Warehouse Engineer to monitor and manage the Group's data warehouse, based in Gauteng Centurion. · If you are someone with the required skill set and have a fun-loving demeanour, you will fit in well with our upbeat environ ...

  • Dimension Data

    Senior Data Engineer-

    4 days ago

    Dimension Data Sandton, South Africa

    Functieomschrijving · About Dimension Data · At Dimension Data we empowering our people to deliver client-centric solutions. We want to see our people make the most of every opportunity, and together we can achieve the extraordinary. Our diverse and inspiring people are experts a ...

  • HR Genie

    Senior Data Engineer X5

    2 days ago

    HR Genie Sandton, South Africa

    Our Client a Global Tech firm is seeking a 5 Senior Data Engineers to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. · The Data Engineer skill is required to enable the data lifecycle within EDS, nam ...

  • Absa Bank Limited

    Domain Drive Data Specialist

    1 day ago

    Absa Bank Limited Sandton, South Africa

    Empowering Africa's tomorrow, together one story at a time. · - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to re ...

  • HR Genie

    Data Modelers X3

    1 week ago

    HR Genie Sandton, South Africa

    Our Client a Global Tech firm is seeking 3 Data Modellers to join their team in Sandton on a contract basis. They offer stability, attractive rates, growth and a great working environment. · The role entails architecting the data platform layer, data cleansing layer, reporting an ...

  • Discovery Ltd.

    Data Architect

    5 days ago

    Discovery Ltd. Sandton, South Africa

    **Business Unit**:Discovery Health**Function**:Business Intelligence**Date**:9 Jun 2023**Discovery - Health** · **DATA ARCHITECT** · **Why you should work at Discovery.** · - Discovery is a high-performance organisation that prides itself in attracting the finest talent, we chall ...

  • Kamo Placements

    Esg Information Analyst

    1 week ago

    Kamo Placements Sandton, South Africa

    *** · **Client Engagement**: · - Engage company business partners / stakeholders on the Data and Information Requirements (initially related GHG data requirements) and all other ESG and Sustainability Impact Data requirements · - Engage internal stakeholders on GHG related Data a ...

  • Absa Bank Limited

    Specialist Data Scientist

    1 week ago

    Absa Bank Limited Sandton, South Africa

    Bring your possibility to life Define your career with us · - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to rese ...

  • Absa Bank Limited

    Specialist Data Analyst

    3 days ago

    Absa Bank Limited Sandton, South Africa

    Bring your possibility to life Define your career with us · - With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to rese ...

  • Kamo Placement

    Esg Information Analyst

    1 week ago

    Kamo Placement Sandton, South Africa

    Gauteng, Sandton · - Annually Cost To Company (Market related, Negotiable) · - Points that provide a holistic explanation of the job · - To collect information from all existing clients relating to Environmental Social & Governance (ESG), with specific focus on Greenhouse Gas (GH ...

  • Core Group

    Senior Business Intelligence and Data Manager

    1 day ago

    Core Group Sandton, South Africa

    As a Senior Business Intelligence Manager, you will lead our business intelligence efforts, managing a dynamic team while leveraging your expertise in various data tools. You will be responsible for designing and implementing robust BI solutions, overseeing the creation and manag ...

  • Dimension Data

    Solution Analyst

    5 days ago

    Dimension Data Sandton, South Africa

    **Requirements · - Ensure successful implementation and embedment of effective DevOps solutions (i.e. SAST, DAST, CWPP, SCA, etc) · - Assist the Engineering and Development teams to build effective and secure CI/CD pipelines, assisting in the configuration and maintenance of the ...

  • Discovery Ltd.

    Head: Business Analytics

    1 week ago

    Discovery Ltd. Sandton, South Africa

    **Business Unit**:Discovery Bank**Function**:Banking**Date**:16-Jan-2023- Head: Business Analytics**About Discovery** · - Discovery's core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand ...

  • HR Genie

    Solutions Analyst

    1 week ago

    HR Genie Sandton, South Africa

    Our Client a Global tech firm is seeking a Solutions Analyst to join their team in Sandton on a contract basis. They offer stability, growth, attractive rates and a great working environment. · **Requirements**: · - Ensure successful implementation and embedment of effective DevO ...

  • Boardroom Appointments

    Solution Analyst

    3 days ago

    Boardroom Appointments Sandton, South Africa

    **Key purpose**: · **Duties and responsibilities**: · - Ensure successful implementation and embedment of effective DevOps solutions (i.e. SAST, DAST, CWPP, SCA, etc) · - Assist the Engineering and Development teams to build effective and secure CI/CD pipelines, assisting in the ...

  • Adcorp Holdings

    BI Specialist

    6 days ago

    Adcorp Holdings Sandton, South Africa

    **Synopsis** · The **BI Specialist** plays a critical role in shaping and enhancing the overall experience for internal employees. The potential incumbent will partner with business stakeholders to set clear **business KPIs and build dashboards** that provide timely and strategic ...

  • Fides Recrutiemt

    Geologist

    1 week ago

    Fides Recrutiemt Sandton, South Africa

    **Geology - Engineering** · **Primary Position Purpose** · - Engineering Geology specialist for the site team. · **Key Responsibilities** · - Engineering Geology specialist for the site team, to be full-time in Lesotho during excavation of the Drill and blast and TBM waterway tun ...