Jobs
>
Cape Town

    IT Data Engineer - Cape Town, South Africa - Armstrong Appointments

    Armstrong Appointments
    Armstrong Appointments Cape Town, South Africa

    Found in: Talent ZA 2A C2 - 6 days ago

    Armstrong Appointments background
    Description

    Our client based in Cape Town are currently seeking the skills of an IT Data Engineer to assist in designing and implementing scalable and robust processes to support the data engineering capability. This role will be responsible for extracting and transforming massive amounts of data at scale and consolidating this data into a bigger data ecosystem.

    Main job function

    Assist in designing and implementing scalable and robust processes for ingesting and transforming large data sets.

    Assist in the design and implementation of data pipelines from a variety of data sources and support the maintenance thereof.

    Ingest large, complex data sets that meet functional and non-functional requirements.

    Enable the business to solve the problem of working with large volumes of data in diverse formats, and in doing so, enable innovative solutions.

    Build bulk and delta data patterns for optimal extraction, transformation, and loading of data.

    Supports the organisations cloud strategy and alignment to data architecture and data governance.

    Engineer data in the appropriate formats for downstream consumption for analytics or Enterprise applications.

    Assist in the development of APIs to expose the data to Enterprise Applications and 3rd party vendors.

    Assist in identifying, designing and implementing robust process improvement activities to drive efficiency and automation for greater scalability. This includes looking at new solutions and new ways of working and being on the forefront of emerging technologies.

    Work with various stakeholders across the organisation to understand data requirements and apply technical knowledge of data management to solve key business problems.

    Provide support in the operational environment with all relevant support teams for data services.

    Create and maintain functional requirements and system specifications in support of data architecture and detailed design specifications for current and future designs.

    Support test and deployment of new services and features.

    Qualifications

    Bachelors degree in Computer Science, Business Informatics, Mathematics, Statistics or Engineering

    Criteria

    4 - 5 years relevant data engineering experience.

    A strong understanding of data structures, algorithms, and effective software design.

    Significant experience working with structured and unstructured data at scale and different data stores such as key-value, document, columnar, etc. as well as traditional RDBMS and data warehouses.

    Good programming, performance tuning and troubleshooting skills using programming languages such as python, scala, java and C .

    Practical experience with Apache Spark and AWS services such as Redshift, Glue, Lambda, EMR, S3, IAM, RDS, etc.

    Experience wrangling terabytes of big, complicated, imperfect data.

    Experience with designing and implementing Cloud (AWS) solutions including use of APIs available.

    Experience with DevOPS architecture, implementation and operation would be advantageous.

    Experience with version control systems such as Git, SVN.

    Excellent verbal and written communication skills; must work well in an agile, collaborative team environment.

    Knowledge of Engineering and Operational Excellence using standard methodologies. Best practices in software engineering, data management, data storage, data computing and distributed systems to solve business problems with data.

    Some experience in applying SAFe/Scrum/Kanban methodologies would be advantageous.

    Knowledge and understanding of business process management lifecycle which covers the design, modelling, execution, monitoring, and optimization as well as business process re-engineering.

    Good problem-solving skills

    The ability to exercise judgment in solving technical, operational, and organizational challenges, to identify issues proactively, to present solutions and options leading to resolution

    Additional Criteria

    Is aware of and responsive to internal and external events and influences on the technical landscape

    Ability to research technology-related concepts, trends, and best practices, and apply findings

    Appropriately derives and organises the essence of information to draw solid conclusions

    Proactively approaches others to obtain missing information

    Demonstrates a results-oriented mindset in planning and implementing activities/projects

    Monitors and tracks progress to ensure delivery of all planned commitments, and keeps the appropriate people informed

    Prepares written reports and briefs and communicates ideas clearly

    Speaks fluently in team meetings when presenting information

    Manages existing partnerships within established agreements or contracts; negotiates adjustments when mutually beneficial to do so

    Genuinely cultivates personal bonds with colleagues to enhance performance throughout the organisation

    Adjusts to work effectively within new work structures, processes, requirements, or cultures

    Demonstrates resourcefulness in acquiring necessary knowledge, skills, and competencies to adapt to change

    A Consultant will be in touch if you are shortlisted for the position. Please consider your application unsuccessful should you not have been contacted within 2 weeks. We will keep your CV on our database and contact you should you match the criteria of any other vacancies.

  • IOCO

    Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    IOCO Cape Town, South Africa

    We are seeking an experienced Data Migration Engineer to join our team on a contract basis to facilitate this migration process. The ideal candidates will have strong expertise in data engineering, particularly with Azure Synapse services, SSIS, and API integration. · What you'll ...

  • PBT Group

    Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa

    We currently have numerous vacancies for Data Engineers skilled in tools such as the Microsoft Stack (SSIS, SSRS, SSAS), Power BI, AWS, Azure, DataStage, SAS etc. · Duties: · Design, develop, test and deploy ETL for ODS and data mart projects, as well as application and managemen ...

  • 60degrees

    Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    60degrees Cape Town, South Africa Permanent Full time

    Job Description · Data Engineer (Gauteng) · Compensation: R – R per annum · Working model: Hybrid · The opportunity that awaits you: · Our client, a solutions energy engineering solution provider with projects mainly in Sub-Saharan Africa seeks to expand their team. Our cl ...

  • Dimension Data

    Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    Dimension Data Cape Town, South Africa temporary

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and ...

  • DLK Group

    Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    DLK Group Cape Town, South Africa Contract

    Job Description · Modifying the database structure, asnecessary, from information given by application developers. · Enrolling users and maintaining systemsecurity. · Controlling and monitoring user accessto the database. · Monitoring and optimizing the performanceof the databas ...

  • PBT Group

    Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group has a requirement for an intermediate Data Engineers skilled in AWS, SQL, Oracle, legacy systems, infrastructure, Cobol. · Duties: · Design, develop, test and deploy ETL for ODS and data mart projects, as well as application and management reports. · Provide technical s ...

  • Isilumko Staffing

    Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    Isilumko Staffing Cape Town, South Africa Full time

    Degree - Computer Science / Engineering / Informatics / Applied Mathematics / Statistics / Information Systems · Min 3-5 years with Microsoft BI Stack - SSIS, SSRS and T-SQL · MS SQL Server and Cloud Data Systems · Relational Database Management · Data modelling · Systems analysi ...

  • iSanqa

    Data Engineer

    Found in: Talent ZA C2 - 2 days ago

    iSanqa Cape Town, South Africa Full time

    Requirements · Solid 5+ years of experience with Azure Data Factory, Databricks, and Power BI. · Degree in Computer Science, IT, or a related field with a strong analytical focus. · Proficiency in Python, particularly in the context of data manipulation and notebook-based analyti ...

  • Cletech Recruitment

    Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    Cletech Recruitment Cape Town, South Africa

    Responsibilities:Configure and implement software, meeting asset managers research & investment process needs. · Develop end-to-end data service solutions, ensuring client data needs in financial markets are met. · Collaborate closely clients to provide support, enhance service ...

  • PBT Group

    AWS Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa

    PBT Group has an opportunity for an AWS Data Engineer, preferably with Hadoop experience. · Duties: · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spa ...

  • PBT Group

    DevOps Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa

    PBT Group has a requirement for an intermediate DevOps Data Engineer. · Duties: · Strong experience with AWS, Terraform, CI/CD, Git · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in co ...

  • PBT Group

    DevOps Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa

    PBT Group has a requirement for an intermediate DevOps Data Engineer. · Duties: · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, K ...

  • PBT Group

    Data Streaming Engineer

    Found in: Talent ZA C2 - 4 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be respons ...

  • Hire Resolve

    Senior Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    Hire Resolve Cape Town, South Africa Full time

    Hire Resolve is currently seeking a highly skilled Data Engineer to join their client's internationally based team. Their Data Engineer will be based in Cape Town with the Data Team, who work on a hybrid work model. · Requirements · Bachelor's degree in Computer Science or a rela ...

  • PBT Group

    AWS Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. · The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers ...

  • Boldr

    Data Integration Engineer

    Found in: Talent ZA C2 - 6 hours ago

    Boldr Cape Town, South Africa Full time

    A LITTLE BIT ABOUT Boldr · Boldr is the first global B-Corp dedicated to delivering world-class Client experiences while creating access to dignified, meaningful work in communities around the world. · We are a global team, united by our desire to connect diverse people with comm ...

  • IO Global

    Senior Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    IO Global Cape Town, South Africa Full time

    Summary · IO Global (IOG), the creator of the Cardano blockchain platform, is searching for a Senior Data Engineer, preferably with a DeFi background. IOG is creating a spinout venture that combines crypto/Web3/DeFi innovations with traditional finance (TradFi) to make borrowing ...

  • PBT Group

    SQL Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group, leaders in Business Intelligence, has a vacancy for a Microsoft SQL Data Engineer. · Duties: · Plan and analyse complex business requirements and implement technology enabled solutions to address multi-discipline business opportunities/problems. · Conduct planning, ana ...

  • Crypto Banter

    Data & QA Engineer

    Found in: beBee S2 ZA - 6 days ago

    Crypto Banter Western Cape, Cape Town, South Africa Full time

    Crypto Banter's job vacancy, Career and Recruitment · Job title : Data & QA Engineer jobs in Western Cape · Job Location : Western Cape, Cape Town · Deadline : May 01, 2024 · Quick Recommended Links · Jobs by Location · Job by industries · Role Overview: · We're seeking a multif ...

  • PBT Group

    Kafka Big Data Engineer

    Found in: Talent ZA C2 - 4 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group has an opportunity for a Kafka Big Data Engineer. As a Kafka Engineer, you will be responsible for the building, improvement and scaling of our streaming data platform. This role requires a combination of strong technical skills, deep understanding of distributed system ...