Data Engineer Umhlanga - Umhlanga Rocks - Careerbox

Description

Data Engineer Job Description

The data engineer is responsible for expanding and optimizing our data architecture, as well as ensuring optimal data delivery across teams. They will support software developers, database architects, data warehouse managers, data analysts, and data scientists on data initiatives and ensure consistency throughout ongoing projects.

Duties & Responsibilities

Key Responsibilities:

• Create and maintain optimal data pipeline architecture.
• Assemble large, complex data sets that meet business requirements.
• Build infrastructure required for extraction, transformation, and loading of data from various sources using SQL and big data technologies.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Create data tools for analytics and data science teams.
• Collaborate with data experts to enhance functionality in data systems.
• Map data between source systems, data warehouses, and data marts.
• Ensure data security and integrity across multiple regions.
• Implement business rules via stored procedures or other technologies.
• Develop data extraction procedures from external systems.
• Create supporting documentation for data systems.
• Design and implement process improvements: automating manual processes, optimizing data delivery, etc.
• Select methods for database evaluative procedures.
• Build analytics tools to provide actionable insights into key business metrics.
• Design reporting systems for processes.
• Analyze system requirements and gather business information.
• Research and implement technologies to optimize data warehouse performance.

Desired Experience & Qualifications

Experience, Knowledge, and Qualifications:

• A Database Administrator with 3 years of experience in writing queries, extracting data, and managing large volumes of records.
• Previous experience with Relational and/or NoSQL databases is essential.
• ETL process expertise is required.
• A qualification in Data Informatics or 3+ years of relevant experience in large data environments.
• Experience managing a team of analysts and technical expertise in writing complex database queries.