Data Engineer - Randburg - Puma Energy

    Puma Energy
    Puma Energy Randburg

    3 days ago

    Default job background
    Description

    Main Purpose:

    Collaborate with data scientists and business stakeholders to design, develop, and maintain efficient data pipelines feeding into the organization's data lake.

    Ensure the data lake contains accurate, up-to-date, and high-quality data, enabling data scientists to develop insightful analytics and business stakeholders to make well-informed decisions.

    Utilize expertise in data engineering and cloud technologies to contribute to the overall success of the organization by providing the necessary data infrastructure and fostering a data-driven culture.

    Demonstrate a strong architectural sense in defining data models, leveraging the Poly-base concept to optimize data storage and access.

    Facilitate seamless data integration and management across the organization, ensuring a robust and scalable data architecture.

    Take responsibility for defining and designing the data catalogue, effectively modelling all data within the organization, to enable efficient data discovery, access, and management for various stakeholders.

    Key Responsibilities:

    • Design, develop, optimize, and maintain data architecture and pipelines that adhere to ETL principles and business goals.
    • Develop complex queries and solutions using Scala, .NET, Python/PySpark languages.
    • Implement and maintain data solutions on Azure Data Factory, Azure Data Lake, and Databricks.
    • Create data products for analytics and data scientist team members to improve their productivity.
    • Advise, consult, mentor, and coach other data and analytic professionals on data standards and practices.
    • Foster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytical solutions.
    • Lead the evaluation, implementation, and deployment of emerging tools and processes for analytic data engineering in order to improve our productivity as a team.
    • Develop and deliver communication and education plans on analytic data engineering capabilities, standards, and processes.
    • Partner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.
    • Collaborate with other team members and effectively influence, direct, and monitor project work.
    • Develop strong understanding of the business and support decision making.

    Requirements:

    • 10 years of overall experience & at least 5 years of relevant experience.
    • 5 years of experience working with Azure Data Factory & Databricks in a retail environment.

    Knowledge, Skills and Abilities:

    • Bachelor's degree required; Computer Science Engineering.
    • 5+ years of experience working in data engineering or architecture role.
    • Expertise in SQL and data analysis and experience with at least one programming language (Scala and .NET preferred).
    • Experience developing and maintaining data warehouses in big data solutions.
    • Experience with Azure Data Lake, Azure Data Factory, and Databricks in the data and analytics space is a must.
    • Database development experience using Hadoop or Big Query and experience with a variety of relational, NoSQL, and cloud data lake technologies.
    • Worked with BI tools such as Tableau, Power BI, Looker, Shiny.
    • Conceptual knowledge of data and analytics, such as dimensional modelling, ETL, reporting tools, data governance, data warehousing, and structured and unstructured data.
    • Big Data Development experience using Hive, Impala, Spark, and familiarity with Kafka.
    • Exposure to machine learning, data science, computer vision, artificial intelligence, statistics, and/or applied mathematics.

    Languages:

    • Fluency in verbal and written English mandatory.
    • Fluency in Spanish & French is useful.

    Key Relationships and Department Overview:

    • Internal: CEO & COO of Africa, Managers across various departments, Senior Management, Head of Departments in other regional hubs of Puma Energy.
    • External: External Consultants.
  • PBT Group

    Data Engineer

    4 days ago

    PBT Group Randburg

    Data Engineer Role at PBT Group · PBT Group is seeking a seasoned Data Engineer with expertise in T-SQL & Power BI to develop, optimize, and maintain data solutions. · The ideal candidate will have a solid background in SQL-based ETL development, data modeling, and reporting, wit ...

  • CIBA Industries

    Data Engineer

    1 week ago

    CIBA Industries Randburg

    Job Title: Data Engineer · Location: Johannesburg · Job Type: Contract (8-month contract) · Work Arrangement: Hybrid · CIBA Industries is seeking a skilled Data Engineer to join the team on a contract basis, working within a dynamic and fast-paced banking/financial services envir ...

  • Network IT

    Data Engineer

    1 week ago

    Network IT Randburg

    Senior Data Engineer Role · This is a senior data engineer position within our organization's data science team. The successful candidate will be responsible for designing and maintaining the company's data infrastructure. · Key Responsibilities · Design and implement enterprise- ...

  • FirstRand Namibia Limited

    Data Engineer

    1 week ago

    FirstRand Namibia Limited Randburg

    Job Title: · Data Architect · Job Summary · We are seeking a highly skilled Data Architect to join our team at Firstrand Namibia Limited. The successful candidate will be responsible for ensuring effective movement, collection, integration, storage, and provisioning of data to me ...

  • firstrand

    Data Engineer

    1 week ago

    firstrand Randburg

    Job Summary · This role is responsible for ensuring effective data management across the organisation. The successful candidate will be involved in data collection, integration, and provisioning to meet business objectives. They will collaborate with stakeholders to understand bu ...

  • Kamo Placements

    Data Engineer

    1 week ago

    Kamo Placements Sandton

    JOB DESCRIPTION · We are seeking a skilled Data Engineer to execute the BCT Divisional plans and monitor performance based on Service Level Agreements (SLA). · The ideal candidate will identify strategic opportunities to meet business needs by leveraging technology. · Data Archit ...

  • Brambles

    Data Engineer

    1 week ago

    Brambles Sandton

    CHEP helps move more goods to more people, in more places than any other organization on earth via our 347 million pallets, crates and containers. We employ approximately 13,000 people and operate in 60 countries. Through our pioneering and sustainable share-and-reuse business mo ...

  • Network IT

    Senior data engineer

    1 week ago

    Network IT Randburg

    Senior Data Engineer · We are seeking a Senior Data Engineer to join our organization at our Johannesburg branch. This individual will be part of the Data Science Team and responsible for the organization's data structure. · Duties & Responsibilities · Main Responsibilities: · Co ...

  • Job Masters

    IT Data Centre Engineer

    6 days ago

    Job Masters Randburg

    Job Title: IT Datacentre Engineer · This position is responsible for the design, implementation, maintenance, and optimization of data centre infrastructure ensuring high availability, reliability, and security of critical systems and services housed within the data centre enviro ...

  • Goldman Tech Resourcing

    Data Engineering Team Lead

    1 week ago

    Goldman Tech Resourcing Randburg

    Transforming Data Engineering: A Leadership Opportunity · About the Role · We seek an experienced data engineering leader to drive technical excellence and mentor a talented team of engineers and analysts. As Data Engineering Team Lead, you will oversee the development and mainte ...

  • Liquid Thought

    Senior Data Engineer

    1 week ago

    Liquid Thought Sandton

    Data Engineer Position · The ideal candidate will utilize their passion for big data and analytics to provide valuable insights to the business across a range of topics. This includes conducting both recurring and ad hoc analysis for business users. · Key Responsibilities · Colla ...

  • Network IT

    Entry Level Data Engineer

    4 days ago

    Network IT Randburg

    Job Title: Junior Data Engineer · We are seeking a talented Junior Data Engineer to join our team at Network-IT in Johannesburg. As a key member of our data analytics company, you will play a crucial role in implementing data architecture and staying up-to-date with the latest da ...

  • DeARX

    Hadoop Data Engineer

    1 week ago

    DeARX Sandton

    Transforming Data Infrastructure at Dearx · A leading bank in Sandton seeks a skilled Data Engineer to spearhead the transformation of their data infrastructure. This is an exciting opportunity to leverage expertise in Ab Initio and drive innovation. · Data Engineering Expertise ...

  • Bidvest Bank Limited

    Senior Data Engineer

    1 week ago

    Bidvest Bank Limited Sandton

    **Job Title:** Data Engineer · The successful candidate will be responsible for developing and maintaining the data analytics capabilities that provide insight and aid quick decision-making. This role requires a specialized skill to effectively manage and develop data and analyti ...

  • Network IT

    Data Engineer Johannesburg North

    2 hours ago

    Network IT Randburg

    Senior Data Engineer Position · We are seeking a highly skilled Senior Data Engineer to join our team at the Johannesburg branch. The successful candidate will work within our Data Science Team, responsible for maintaining and optimizing our organization's data structure. · Dutie ...

  • Datacentrix

    Senior Data Engineer

    1 week ago

    Datacentrix Sandton

    Senior Data Engineer · Our client is seeking a highly skilled Senior Data Engineer to design, build and implement data and analytics products and solutions that enable our journey towards becoming an insights-led organization. · This role requires collaboration with cross-functio ...

  • RedScreen (Pty) Ltd.

    Senior Data Engineer

    1 week ago

    RedScreen (Pty) Ltd. Sandton

    RedScreen (Pty) Ltd is a leading developer of software systems for the Banking sector. · We operate in a competitive market to create and maintain top-quality products, solutions, and services. · About Our Team · We prioritise investing in our people to uphold our reputation for ...

  • Bidvest Bank Limited

    Senior Data Engineer

    1 week ago

    Bidvest Bank Limited Sandton

    Job Description for Data Engineer · Primary Purpose: A specialized skill is required to effectively manage and develop data and analytics capabilities that provide insight and aid quick decision making. · A Data Engineer will extract and acquire data from different sources and ap ...

  • Network IT

    Senior Data Engineer Johannesburg North

    1 week ago

    Network IT Randburg

    Senior Data Engineer · Sought after by a prominent international marketing organization with multiple overseas branches, our ideal candidate will contribute to the Johannesburg team as a Senior Data Engineer on a hybrid module. This role is crucial for maintaining and enhancing t ...

  • PBT Group

    Oracle / Ab Initio Data Engineer

    6 days ago

    PBT Group Randburg

    Job Title: Oracle / Ab Initio Data Engineer · We are seeking a skilled data professional with expertise in designing, developing, and maintaining robust data solutions that support business intelligence and analytics needs. · This role requires a deep understanding of database ma ...

Jobs
>
Randburg
>
Data engineer