- Experience of developing solutions in the cloud
- At least 2-3 years' experience with designing and developing streaming Data Pipelines for Data Ingestion or Transformation using AWS technologies
- Experience with distributed log systems, such as Kafka and AWS Kinesis
- redPanda or Confluence experience advantageous
- Experience in developing data warehouses and data marts
- Experience in Data Vault and Dimensional modelling techniques
- Experience working with automated data warehousing solutions would be advantageous
- Bachelor's Degree in Computer Science or similar fields like Information Systems, Big Data, etc.
- AWS Data Engineer Certification would be advantageous
- Related Technical certifications
- Build, enhance, and maintain our real-time data pipeline
- Work with various infrastructure and operations teams to maintain our data infrastructure
- Be self-driven in identifying and documenting feature gaps, and designing and implementing solutions to them
- Help build, modernize, and maintain services and tooling to ensure resiliency, fix data discrepancies, and enhance the customer experience
- Monitor daily execution, diagnose and log issues, and fix pipelines to ensure SLAs are met with internal stakeholders
- Mentor other engineers and help them grow; code reviews, guidance on best practices, leveraging your experience in the field
- Participate in the engineering and other discipline's community of practice
- Share AWS knowledge and practical experience with community
- Challenge and contribute to development of architectural principals and patterns
- Ensure solutions adhere to Olympus patterns, guidelines and standards
- Operate within project environments and participate in continuous improvement efforts
- Follow and participate in defined ways of work including, but not limited to, sprint planning, backlog grooming, retrospectives, demos and PI planning
-
AWS Data Engineer with DataBricks
Found in: Executive Placements ZA C2 - 3 days ago
PBT Group Johannesburg, South Africa ContractPBT Group has an opportunity for an AWS Data Engineer, with DataBricks experience. · Duties: · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spark, EMR ...
-
Services Sales Engineer
Found in: Executive Placements ZA C2 - 5 days ago
TalentCru Johannesburg, South AfricaAre you a dynamic professional with a passion for electronic engineering and a knack for sales? Our client is on the lookout for a talented individual to fill the role of a Services Sales Engineer. If you're ready to take on a challenging yet rewarding position, read on · Diploma ...
-
Data Voice Engineer
Found in: Talent ZA C2 - 2 days ago
IT Ridge Technologies Johannesburg, South Africa Full timeData Voice (interaction management software) Nexus and Libre expertise is fundamental with a specialized focus on the secure recording of multiple streams and channels. From Voice, email and chat applications across multiple platforms deployed. We are looking for a senior enginee ...
-
Systems Integration Manager
Found in: Talent ZA C2 - 4 days ago
FORTNA Johannesburg, South Africa Full timeFORTNA partners with the world's leading brands to transform omnichannel and parcel distribution operations. Known world-wide for enabling companies to keep pace with digital disruption and growth objectives, we design and deliver solutions, powered by intelligent software, to op ...
-
Finance Manager
Found in: Executive Placements ZA C2 - 3 days ago
The Human Element Johannesburg, South AfricaOur client is a well-established Engineer and Construction Company and is seeking a Financial Manager to lead and provide strategic direction to all the business units as well as manage its Finance division and related workstreams. · The successful incumbent will be responsible f ...
-
Senior Data Engineer
Found in: Talent ZA 2A C2 - 3 days ago
The Individual Touch Johannesburg, South AfricaYou will take responsibility for managing our master data set, developing reports, and troubleshooting data issues. To do well in this role you need a very fine eye for detail, experience as a data analyst, and deep understanding of the popular data analysis tools and databases: ...
-
BI Big Data Engineer – Johannesburg – up to R950k per annum
Found in: Executive Placements ZA C2 - 2 days ago
E-Merge Johannesburg, South AfricaAn expert in integrated corporate benefits well known for outstanding usability and integration within the banking space is looking for a specialist capable of working within the capacity of a BI Big Data Engineer who will be responsible for building and maintaining data pipeline ...
-
Azure Cloud Engineer
Found in: Executive Placements ZA C2 - 2 days ago
E-Merge Johannesburg, South AfricaA long serving bank and financial services group known as Africa''s biggest lender by assets requires the services of an Azure Cloud Engineer, your role will be to support and contribute to a number of products or work streams relating to the design and implementation of Cloud so ...
-
Technology/Domain Specialist II
Found in: Talent ZA C2 - 3 days ago
Nedbank Johannesburg, South AfricaJob ID · Microsoft Dynamics 365) · Closing Date: 06 May 2024 · Job Family · Information Technology · Career Stream · Application Development · Leadership Pipeline · Manage Self: Professional · Job Purpose · To actively own and be accountable for the overall evolution of multiple ...
-
Specialist Process Engineer
Found in: Talent ZA 2A C2 - 2 days ago
TalentCru Johannesburg, South AfricaOur client from the banking industry is looking for a Specialist Process Engineer it is a 12-month contract. · 3 -5 years in process optimization roles · Scientific methodologies associated with efficiency. · Improvements, i.e. queuing theories, BPR and Lean methodologies. · Ide ...
-
Technical Delivery Manager
Found in: Talent ZA C2 - 4 days ago
Telebest Johannesburg, South Africa Full timeOur client has an opportunity available for a Technical Delivery Manager based in Selby. · Requirements: · 5 years' experience in;Leading the technical project delivery of complex enterprise application systems, distributed applications, web applications, and system integration s ...
-
Technology/Domain Specialist II
Found in: beBee S2 ZA - 3 days ago
Nedbank Johannesburg, South AfricaJob ID · F5 Product) · Job Family · Information Technology · Career Stream · Application Development · Leadership Pipeline · Manage Self: Professional · Job Purpose · To actively own and be accountable for the overall evolution of multiple Technology or Domain assets while influe ...
-
Quantitative Analyst Graduate 2025
Found in: Talent ZA C2 - 4 days ago
Nedbank Johannesburg, South AfricaJob Family · Administration, Operations and FacilitiesCareer Stream · Administration, Transactional Processing and Production · Leadership Pipeline · Manage Self: Technical · Job Purpose · To develop world class Quantitative Analysts through the Nedbank Quants Graduate Programme. ...
-
Business Transformation Analyst
Found in: Talent ZA C2 - 2 days ago
Nedbank Johannesburg, South AfricaJob Classification · Job Family · Project, Process and Product · Career Stream · ProcessFAIS Affected · Leadership Pipeline · Manage Self: Professional (MSP) · Job Purpose · The Digitization and Automation team at Nedbank is at the forefront of digital innovation, crafting robust ...
-
Senior C# Azure Cloud Developer
Found in: Talent ZA 2A C2 - 13 hours ago
E-Merge Johannesburg, South AfricaThis role is worth celebrating You will be one of the lucky few to work on a global automotive system and Greenfield type tech/project. You will work on a cutting edge global IT system landscape and processes including IoT, Cloud + Edge computing, Human-to-machine/ Machine-to-mac ...
-
Data Commercialisation Analyst
Found in: Talent ZA C2 - 6 days ago
Nedbank Johannesburg, South AfricaRequisition Number and Talent Acquisition Contact · REQ: 133063 · Location: Sandton, Johannesburg · Closing Date: 30 April 2024 · Talent Acquisition: Saranya Govender · Job Family · Information Technology · If you are a data enthusiast that loves crunching numbers, spotting tre ...
-
Software Developer II
Found in: Talent ZA C2 - 6 days ago
Nedbank Johannesburg, South AfricaRequisition Details & Talent Acquisition Consultant · REQ Thembi Mtshali · Job Family · Information Technology · Career Stream · Application Development · Leadership Pipeline · Manage Self: Technical · Job Purpose · To realise the detailed design through programming and configur ...
-
Software Developer II
Found in: Talent ZA C2 - 5 days ago
Nedbank Johannesburg, South AfricaRequisition Details & Talent Acquisition Consultant · REQ Thembi Mtshali · Job Family · Information Technology · Career Stream · Application Development · Leadership Pipeline · Manage Self: Technical · FAIS Affected · Job Purpose · To realise the detailed design through programm ...
-
Quality Assurance Lead
Found in: Talent ZA C2 - 4 days ago
Nedbank Johannesburg, South AfricaRequisition Details · REQ 130550 · Job Family · Informaton Technology · Career Stream · IT Operations · Leadership Pipeline · Manager of Others · Job Purpose · To Lead the Test Implementation in accordance with the agreed Quality Assurance principles and standards in order to man ...
-
Senior Quantitative Analyst
Found in: Talent ZA C2 - 2 days ago
Nedbank Johannesburg, South AfricaRequisition Number and Talent Acquisition · REQ: 133530 · Location: Sandton, Johannesburg · Closing Date: 7 May 2024 · Talent Acquisition: Saranya Govender · Job Family · Investment BankingCareer Stream · QuantitativeLeadership Pipeline · Manage Self: ProfessionalJob Purpose · T ...
Data Streaming Engineer - Johannesburg, South Africa - Golden Rule
Description
The Role
An opportunity exists for a Senior Data Streaming Engineer who will Build, enhance, and maintain our real-time data pipeline. The role will work with various infrastructure and operations teams to maintain our data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the continued growth of the bank. You will collaborate with many teams across the bank to understand data needs and turn them into platforms and services, monitor and maintain the health of the data streams, and have an impact on the data ecosystem within Square.
Skills and Experience
Experience
Qualifications
Other
Operational Delivery
Technical Leadership
Compliance
Delivery Management