- Design, develop, and maintain scalable data pipelines to process and transform large volumes of data.
- Integrate data from various sources, ensuring data quality, consistency, and reliability.
- Optimise data storage and processing for performance, scalability, and cost efficiency.
- Collaborate with data scientists, analysts, and business stakeholders to support data-driven decision-making.
- Implement and manage big data platforms and tools such as Hadoop, Apache Spark, and Kafka.
- Ensure data security, compliance, and governance across all data processes.
- Monitor and troubleshoot data pipelines to ensure smooth operation and minimal downtime.
- Stay updated with the latest trends and technologies in data engineering and big data.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in big data tools and frameworks (e.g., Hadoop, Apache Spark, Kafka, Apache Flink).
- Expertise in programming languages such as Python, Java, Scala, or SQL.
- Experience with ETL/ELT processes and tools (e.g., Talend, Informatica, Apache NiFi).
- Familiarity with cloud-based data solutions and services, including:
- AWS (Redshift, Glue, EMR, S3)
- Azure (Synapse, Data Factory, Databricks)
- Google Cloud (BigQuery, Dataflow, Pub/Sub)
- Knowledge of database systems, including:
- Relational databases (e.g., PostgreSQL, MySQL, SQL Server)
- NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- Data warehousing solutions (e.g., Snowflake, Redshift, BigQuery)
- Experience with data modeling, data architecture, and data governance best practices.
- Familiarity with workflow orchestration tools like Apache Airflow or Luigi.
- Strong understanding of data security, compliance, and privacy regulations (e.g., POPIA, GDPR).
- Knowledge of containerisation and orchestration tools (e.g., Docker, Kubernetes) is a plus.
- Experience with version control systems (e.g., Git) and CI/CD pipelines.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
- Relevant certifications (e.g., AWS Certified Data Analytics, Google Cloud Data Engineer, Azure Data Engineer Associate) are a plus.
- Capable of contributing to the development of innovative solutions.
- Proven ability to perform effectively under pressure and meet tight deadlines.
- Self-driven with a proactive approach to tasks and challenges.
- Strong team player with the ability to collaborate effectively in a team environment.
-
Business Analyst – Future Talent Pool
13 hours ago
Blue Bean Software CenturionAbout Us · We're a leading custom software and product development company, partnering with large enterprises and start-ups to solve complex challenges. · Our team delivers tailored solutions that blend cutting-edge technology with a deep understanding of our clients' needs. · We ...
-
Mobile Engineer – Future Talent Pool
1 week ago
Blue Bean Software CenturionJob Description · We are seeking talented Mobile Engineers to design, develop, and deliver innovative mobile applications that enhance user experiences across iOS, Android, or cross-platform frameworks. · About Blue Bean Software · At Blue Bean Software, we're not just building s ...
-
DevOps Engineer – Future Talent Pool
17 hours ago
Blue Bean Software CenturionAbout Us · At Blue Bean Software, we're pioneers in custom software and product development. We partner with enterprises and start-ups to solve complex challenges using cutting-edge technology and a deep understanding of our clients' needs. · We deliver tailored solutions that bl ...
-
Solution Architect – Future Talent Pool
17 hours ago
Blue Bean Software CenturionAbout Blue Bean Software · We're shaping the future by building software that solves real-world problems with innovative technology. · Our Mission · We partner with leading enterprises and start-ups to deliver tailored solutions that blend cutting-edge tech with a deep understand ...
-
Cloud Engineer – Future Talent Pool
4 days ago
Blue Bean Software CenturionJob Overview · We are seeking skilled Cloud Engineers to join our team. By joining us, you will have the opportunity to design, implement, and manage scalable, secure, and cost-efficient cloud-based systems. · Your expertise will play a key role in driving our clients' digital tr ...
-
Tester - Talent Pool
4 days ago
Discovery Limited GautengOverview · We are seeking a skilled Tester to join our Talent Pool at Discovery Invest. · The primary function of this role is to identify and test business functional requirements, designing test cases and scenarios based on an analysis of the business specifications. · This pos ...
-
Talent Pool
2 days ago
Nova Pioneer JohannesburgAbout Nova Pioneer · We are a pan-African, independent network of schools offering high quality, accessible education from pre-primary through secondary school. Our unique, enquiry-based learning approach encourages students to ask "why" instead of telling them the "what". It all ...
-
Talent Pool
2 days ago
Discovery Limited SandtonSenior Data Scientist Role · The Discovery Group's Data Science Lab is expanding, and we are seeking talented individuals to join our team. We apply predictive analytics, machine learning, big data, and operations research skills to drive key projects across the organization. · M ...
-
Talent Pool
1 day ago
Discovery Limited SandtonAbout Us · Discovery is a purpose-driven business that enhances and protects people's lives through breakthrough product designs that incentivise healthier lifestyle choices. · We achieve this by leveraging our large and diverse data sets, covering health, wellness, driving, inve ...
-
Talent Pool Legal Advisor MMH230606-11
5 days ago
Guardrisk Group CenturionTalent Pool Legal Advisor · Role Purpose: · Provide specialist legal advice to ensure the legal soundness of operations and effective execution of commercial transactions across the business.Requirements · Experience and Qualification · Relevant Law degree (essential) · Postgradu ...
-
Back End Engineer – Future Talent Pool
17 hours ago
Blue Bean Software CenturionAbout Us · At Blue Bean Software, we're pioneers in custom software and product development. We partner with businesses to solve complex challenges using cutting-edge technology. · We're a community of brilliant minds who thrive in an environment that fosters innovation and growt ...
-
Full Stack Engineer – Future Talent Pool
4 days ago
Blue Bean Software CenturionJob Overview · We are seeking talented Full Stack Engineers to join our team for future opportunities. By working with us, you can design, develop, and maintain end-to-end solutions, working across both frontend and backend technologies. · Main Responsibilities · Develop and main ...
-
Health Consultants Talent Pool
3 days ago
Dis-Chem Pharmacies GautengJob Title: Health Consultant - Vitamins and Supplements · Description: · We are continuously seeking talented individuals to join our team as Health Consultants specialising in Vitamins and Supplements. The primary goal is to build a diverse talent pool for various stores within ...
- Guardrisk Group Centurion
Talent Pool: Investment Regional Manager - Countrywide · This role is responsible for acquiring new Independent Financial Advisors (IFAs) for Momentum, with the goal of effectively placing them in the best panel with the best Business Connections (BCs). The successful candidate w ...
-
Talent Pool: Investment Consultant
1 week ago
Momentum PretoriaMomentum, a leading financial services provider since 1966, is known for its entrepreneurial spirit and innovative culture. We are committed to wealth creation and preservation, insurance, and income protection for all our clients through our understanding of the retail insurance ...
- Guardrisk Insurance Company Limited Centurion
Talent Pool: Regional General Manager · Key Role Summary · The Retail Regional General Manager will acquire new Independent Financial Advisers (IFAs) for Momentum, responsible for effective placement in the best panel with optimal Business Connectivity (BC). Ensuring a high-perfo ...
-
Tester - Talent Pool
3 days ago
Discovery JohannesburgAbout Discovery · Discovery's core purpose is to make people healthier and to enhance and protect their lives. We seek out and invest in exceptional individuals who understand and support our core purpose, and whose own values align with those of Discovery. Our fast-paced and dyn ...
-
Tester - Talent Pool
1 week ago
Discovery Limited Sandton**Core Purpose at Discovery Limited** · Our core purpose is to make people healthier and enhance and protect their lives. We seek exceptional individuals who understand and support our core purpose, with values that align with ours. · About Invest at Discovery Limited · We launch ...
- Momentum Metropolitan Holdings Limited Centurion
Talent Pool: Regional General Manager - Countrywide · Job Summary: · The Retail Regional General Manager will drive profitable growth through the effective placement of Independent Financial Advisors (IFAs) in Momentum's best bancassurance (BC) panel, ensuring a high-performance ...
-
Casual Cashier Talent Pool
1 week ago
Dis-Chem Pharmacies Johannesburg Part timeJob Title: Casual Cashier Talent Pool · A key role in providing exceptional customer service while maintaining a high level of accuracy and security at the point of sale. · Key Responsibilities: · Support customers with world-class shopping experiences, recording transactions on ...
Data Engineer – Future Talent Pool - Centurion - Blue Bean Software

Description
About Blue Bean Software
We're shaping the future by building software that solves complex challenges. As a leading custom software and product development company, we partner with large enterprises and start-ups to deliver tailored solutions that combine cutting-edge technology with deep understanding of our clients' needs.
As pioneers in our field, we continuously push boundaries and redefine what's possible. If you're passionate about solving real-world problems with innovative tech, you'll find a home here.
Our Culture
We're more than a workplace – we're a community of brilliant minds. Our environment enables software engineers, developers, and tech enthusiasts to thrive, grow, and express themselves freely. Here, you'll have the freedom to master your craft, collaborate with like-minded professionals, and tackle challenges that inspire you.
We foster a culture of trust, integrity, and self-motivation. At Blue Bean, you're not just an employee – you're a valued member of a team driven by curiosity, innovation, and a shared passion for excellence.
Our Way of Working
We operate with a flat organisational structure that empowers every team member to make an impact. Collaboration is at the heart of everything we do, and we believe in giving our people the autonomy to make agile decisions and drive results.
We're all about streamlined communication, creative problem-solving, and delivering exceptional customer service. Whether you're working on a high-profile project or brainstorming the next big idea, you'll have the support and freedom to excel.
Data Engineer Role Overview
We are seeking skilled Data Engineers to join our talent pool for future opportunities. By submitting your details, you can be pre-vetted for roles where you can design, build, and manage robust data pipelines and infrastructure. Your expertise will enable organisations to harness the power of data, driving insights and innovation.
Key Responsibilities
Your Skills and Experience
Additional Information
Competencies
Why Join Our Talent Pool?
By joining our talent pool, you'll be first in line for exciting opportunities to become a part of our team, working on innovative projects and cutting-edge technologies.
Here, you're more than just a developer or a designer – you're a catalyst for change in how people interact with technology. Step into a world where digital products don't just function – they make an impact. A world where you carve your own path to success, surrounded by a team that's as authentic as it is exceptional.
Sound like your kind of place?
-
Business Analyst – Future Talent Pool
Blue Bean Software- Centurion
-
Mobile Engineer – Future Talent Pool
Blue Bean Software- Centurion
-
DevOps Engineer – Future Talent Pool
Blue Bean Software- Centurion
-
Solution Architect – Future Talent Pool
Blue Bean Software- Centurion
-
Cloud Engineer – Future Talent Pool
Blue Bean Software- Centurion
-
Tester - Talent Pool
Discovery Limited- Gauteng
-
Talent Pool
Nova Pioneer- Johannesburg
-
Talent Pool
Discovery Limited- Sandton
-
Talent Pool
Discovery Limited- Sandton
-
Talent Pool Legal Advisor MMH230606-11
Guardrisk Group- Centurion
-
Back End Engineer – Future Talent Pool
Blue Bean Software- Centurion
-
Full Stack Engineer – Future Talent Pool
Blue Bean Software- Centurion
-
Health Consultants Talent Pool
Dis-Chem Pharmacies- Gauteng
-
Talent Pool: Investment Regional Manager - Countrywide MMH230620-20
Guardrisk Group- Centurion
-
Talent Pool: Investment Consultant
Momentum- Pretoria
-
Talent Pool: Regional General Manager_ Countrywide MMH230606-5
Guardrisk Insurance Company Limited- Centurion
-
Tester - Talent Pool
Discovery- Johannesburg
-
Tester - Talent Pool
Discovery Limited- Sandton
-
Talent Pool: Regional General Manager_ Countrywide MMH230606-5
Momentum Metropolitan Holdings Limited- Centurion
-
Casual Cashier Talent Pool
Part time Dis-Chem Pharmacies- Johannesburg