- Perform data analysis and normalisation to create features for machine learning applications.
- Ingest data into the data environment in batch or real-time
- Build Meta-data driven data integration solutions
- Develop and maintain APIs for seamless integration of modern data platform with other systems.
- Productise Machine Learning models on a Linux containerized environment to ensure scalability and reliability.
- Administer Linux operating system and exhibit a strong programming experience.
- Utilise distributed programming techniques on a cluster of servers for optimised data processing.
- Collaborate with teams to advise on optimal data system architecture for data warehousing, data lakes, and lakehouses.
- Conduct root cause analysis on production issues surrounding data pipelining and execution
- Technical leadership of entire information management process of both structured and unstructured data
- Optimisation of the solutions for loading and transforming multi structure data
- Create comprehensive technical documentation for data systems, APIs, and processes.
- National Diploma /BTech/Mtech IT or BSC/MSC Computer Science
- 5 years plus experience
- Python, Java, JavaScript, C# (Advanced)
- Spark SQL and R programming (Advanced)
- Building and maintaining API(s) and Webhooks (Advanced)
- Google Analytics data (Advanced)
- Real-time streaming and batch orchestration (Advanced)
- Object Oriented Programming (Advanced)
- SQL programming (Advanced)
- Data Warehouse, Data Lake and Lakehouse (Advanced)
- Git versioning of code (Advanced)
-
E-Merge Johannesburg, South AfricaOne of Africas largest English-language news publishers in print that owns a number of B2B and B2C magazines amongst others while connecting people of all cultures, enabling economies to thrive are in the market for a Data Engineer to contribute to the development of their revolu ...
-
E-Merge Johannesburg, South AfricaA publicly listed organisation well known for its excellent service delivery, diverse company offerings, and customer focused services at the core of its business is currently on a quest to upgrade their technology environment in this pursuit they are in need of a passionate Data ...
-
E-Merge Johannesburg, South AfricaOne of Africas largest publishers in print and owns several B2B and B2C magazines as well as an events division, amongst others while connecting people of all cultures, enabling economies to thrive are in the market for a Data Scientist=. The main purpose of the role is to create ...
-
E-Merge Johannesburg, South AfricaMultinational media and entertainment group headquartered in South Africa, Dubai and the Netherlands with principal operations in pay television, video entertainment, advertising and content security with big brands under their wing is currently scouting for a Senior Data Enginee ...
-
E-Merge Johannesburg, South AfricaA dynamic healthcare non-profit organisation with vast experience in providing both direct service delivery and technical assistance, coupled with its multiple innovations for precision programming in South Africa, has created a role for a Senior BI Developer who will be responsi ...
-
E-Merge Johannesburg, South AfricaOur valued client, who in the market, has seamless integration capabilities with a diverse range of products and financial/payment systems are looking for a skilled and hardworking Hardware/Software Engineer. Their innovative solutions are meticulously crafted in-house, allowing ...
-
E-Merge Johannesburg, South AfricaEmbark on a Journey of Innovation in the Travel Realm · Join forces with a pioneering integrated tourism group in their quest for a dynamic and skilled Senior C# Developer. This well-established organization stands as a cornerstone in the travel industry, boasting a diverse portf ...
-
E-Merge Johannesburg, South AfricaA long serving bank known as Africa''s biggest lender of assets and financial services group committed to providing banking insurance and asset management services have an open role for a Cloud Data Engineer to execute data engineering duties according to the standards, framework ...
-
E-Merge Johannesburg, South AfricaEmbark on an Exciting Expedition into the World of Travel Innovation · Collaborate with a Trailblazing Integrated Tourism Group on their search for a dynamic and experienced Senior C# Developer. This renowned organization is a cornerstone in the travel industry, offering a divers ...
-
E-Merge Johannesburg, South AfricaA cyber risk startup on a mission to make SaaS security compliance smart, effortless, and simple by creating an automated end-to-end solution for startups and tech enterprises that struggle with meeting security audit demands, seek a passionate and hands-on Data Engineer to contr ...
-
E-Merge Johannesburg, South AfricaA leading technology firm with offices in Cape Town and Johannesburg is seeking a skilled Automation Engineer to join their dynamic team. This is a fantastic opportunity for a talented professional looking to work remotely from anywhere in South Africa. · As an Automation Enginee ...
-
E-Merge Johannesburg, South AfricaHigh achieving business analysts An investment banking client has a need for candidates who come from a financial services background and who are technically strong. · Qualifications & Experience - Essential: · Bcom Finance / Bcom info tech / BSc Eng Elec / BSc Comp Sci · 4-7 yea ...
-
E-Merge Johannesburg, South AfricaA Data Consulting company who specializes in Business Intelligence, Machine learning and DataOps is in search of a Data Engineer who will take on the responsibility of analyzing, developing, and testing their specialized data and analytical "formulas". Their team is compact yet d ...
-
E-Merge Johannesburg, South AfricaA driven investment and trading environment that prides itself on pushing the innovation envelope in the banking industry is looking for a Quantitative Business Analyst to join their high energy team. · If you are big on sharing knowledge and ideas, this is for you Join a team th ...
-
E-Merge Johannesburg, South AfricaA client growing rapidly with international ambitions developing multiple valuable products in the areas of supplier risk, customer risk, and third-party risk management are on a recruitment drive for a Data Scientist to apply data mining techniques and conduct statistical analys ...
-
E-Merge Johannesburg, South AfricaJoin a long serving bank and financial services group, committed to providing banking, insurance and asset management services. This bank is counted as Africa''s biggest lender by assets, they are looking for a Data Engineer to execute data engineering duties according to the sta ...
-
E-Merge Johannesburg, South AfricaJoin a leading international company with offices in Cape Town and Johannesburg in a dynamic role as a Systems Engineer. This is a fully remote, permanent position offering an exceptional opportunity to work with cutting-edge technologies. · Key Responsibilities: · Manage and opt ...
-
E-Merge Johannesburg, South AfricaJoin a long serving bank and financial services group, committed to providing banking, insurance and asset management services. This bank is counted as Africa''s biggest lender by assets, they are looking for a Data Engineer to execute data engineering duties according to the sta ...
-
E-Merge Johannesburg, South AfricaA market-leading provider of Testing, Inspection, Certification (TIC), and Training solutions to Africa and the Middle East, focused on food safety and workplace safety has an excellent opportunity for a passionate individual seeking to gain valuable experience and grow their car ...
-
E-Merge Johannesburg, South AfricaOur client with an impressive track record in building, managing and understanding data are expressly recruiting for an Intermediate Data Scientist to work within their data company and join a team of fast-paced, passionate solution makers in implementing technology-agnostic solu ...
BI Big Data Engineer – Johannesburg – up to R950k per annum - E-Merge
Description
An expert in integrated corporate benefits well known for outstanding usability and integration within the banking space is looking for a specialist capable of working within the capacity of a BI Big Data Engineer who will be responsible for building and maintaining data pipelines for new data in a variety of formats using an optimal orchestration method into a modern data platform. The candidate will have deep data engineering skills with experience using different programming languages and working comfortably on Linux or Windows environments.
Responsibilities:
Qualifications and Experience:
The Reference Number for this position is NG58552 which is a Permanent position in Sandton, Johannesburg offering a salary negotiable between R750k to R950k CTC based on experience and skills. E-mail Nokuthula on
BI Big Data Engineer – Johannesburg – up to R950k per annum professionals in Johannesburg
-
Precious Hleza
Marketing Manager
-
Samkelo Siyabonga Ngubo
Senior Full Stack Developer