Data Engineering Leader for High-Performance Scientific Computing - Durban - Carlysle Human Capital

    Carlysle Human Capital
    Carlysle Human Capital Durban

    1 month ago

    Default job background
    Description

    High-Performance Scientific Computing with Data Engineering Expertise



    Carlysle Human Capital seeks a seasoned Data Engineering Leader with a strong background in high-performance computing and data engineering to join our team. The successful candidate will have a proven track record of designing and implementing scalable data pipelines and technical platforms for research-focused environments.



    About the Role



    This is a technical leadership position that requires a high degree of core IT technical background and skills. The ideal candidate will have experience working with various relational database technologies, NoSQL databases, and big data technologies such as Hadoop, Spark, and Hive.



    Key Responsibilities




    • Design and Develop End-to-End Data Pipelines: The successful candidate will design, develop, and maintain end-to-end technical aspects of high-performance compute and storage platforms for data pipelines in research data-intensive environments.

    • Collaborate with Research Scientists and IT Department: The candidate will work closely with research scientists, internal IT, and other stakeholders to ensure data quality, reliability, accessibility, security, and governance.

    • Provide Technical Guidance and Support: The Data Engineering Leader will provide technical guidance and support to data analysts and research scientists.

    • Design Data Integrations and Quality Frameworks: The successful candidate will design data integrations and data quality frameworks to ensure data accuracy and reliability.

    • Work with Big Data Cloud-Based Technologies: Experience working with big data cloud-based technologies such as AWS, Azure, and Google Cloud will be advantageous.

    • Strong Communication and Collaboration Skills: The ideal candidate will have excellent communication, collaboration, and problem-solving skills to work effectively with cross-functional teams.



    Requirements



    To be successful in this role, the candidate will need to have:




    • Bachelor's degree or higher in Computer Science, IT, Engineering, Mathematics, or a related field.

    • Industry-recognized IT-related certification and technology qualification.

    • At least 7 years of experience in data engineering, high-performance computing, data warehousing, or big data processing.

    • Strong experience with technologies such as Hadoop, Kafka, NiFi, or Spark, or cloud-based big data processing environments like Amazon Redshift, Google BigQuery, and Azure Synapse Analytics.

    • At least 5 years of advanced experience and strong proficiency in UNIX, Linux, Windows operating systems, and preferably containerization technologies like Docker, Kubernetes.

    • Working knowledge of various data-related programming, scripting, or data engineering tools such as Python, R, Julia, T-SQL, PowerShell, etc.

    • Strong working experience with software compute and virtualization platforms such as VMware, Hyper-V, OpenStack, KVM, etc.

    • Strong working experience with hardware compute platforms, including high-performance compute cluster hardware and related technologies.



    Estimated Salary



    The estimated salary for this role is $125,000 - $150,000 per year, depending on the candidate's experience and qualifications.



    This is a rare opportunity for a Data Engineering Leader to join our team and contribute to the success of our organization. If you are a seasoned professional with a passion for high-performance scientific computing and data engineering, please submit your application.



    About Carlysle Human Capital



    Carlysle Human Capital is a leading provider of human capital solutions, dedicated to helping organizations succeed through the recruitment and deployment of top talent. We pride ourselves on our ability to understand the unique needs of our clients and provide tailored solutions to meet those needs.



    We believe in creating a workplace culture that values diversity, equity, and inclusion. We are an equal opportunity employer and welcome applications from qualified candidates of all backgrounds.



    Thank you for considering this opportunity to join our team. We look forward to reviewing your application.



    How to Apply



    To apply for this role, please submit your resume and a cover letter outlining your experience and qualifications. We thank all applicants for their interest; however, only those selected for an interview will be contacted.



    Carlysle Human Capital is a remote-first organization, and the successful candidate will be required to work from home with occasional travel to our office.



    We are committed to providing a inclusive and accessible work environment for all employees. If you require accommodations during the application or interview process, please do not hesitate to contact us.



    Thank you for your interest in this opportunity.



  • Isilumko Staffing Durban Full time

    Research Group Manager · We are seeking a highly motivated and experienced Research Group Manager in the field of Medical Science to lead a dynamic research team, produce scientific reports, and manage multiple research projects. · This role requires expertise in research methodo ...


  • LIFE Healthcare Group Durban

    A Registered Nurse vacancy exists in Fyfe 3, based at Life Entabeni Hospital, reporting to the Unit Manager. The successful candidate will ensure effective delivery of quality patient care. · Critical Outputs · Ensure professional and ethical practice in the unit: · Provide and s ...

Jobs
>
Durban