Jobs
>
Cape Town

    Senior Data Engineer I - Cape Town, South Africa - LexisNexis

    LexisNexis
    LexisNexis Cape Town, South Africa

    Found in: Talent ZA C2 - 6 days ago

    Default job background
    Full time
    Description

    Do you have excellent experience building data pipelines?

    Do you enjoy collaborating cross-functionally to deliver on common goals?

    Join us in shaping a more just world.

    About Us

    LexisNexis, a part of RELX, is a leading global provider of legal, regulatory, and business information. We help customers increase productivity and improve decision-making and outcomes. Our 10,500 experts and innovative tools help us shape a better world for our customers and communities.

    About the Role

    At LexisNexis we develop the legal profession's most innovative products for data analysis, visualization, and research. We use the latest techniques in AI, machine learning, and data visualization to uncover insights about judges' rulings, build forecasts of likely outcomes, and reveal critical connections in massive datasets spanning the law, news, and finance.

    Responsibilities

    As a senior machine learning operations engineer on our team, you will work on new product development in a small team environment writing production code in both run-time and build-time environments. You will help propose and build data-driven solutions for high-value customer problems by discovering, extracting, and modeling knowledge from large-scale natural language datasets. You will prototype new ideas, collaborating with other data scientists as well as product designers, data engineers, front-end developers, and a team of expert legal data annotators. You will get the experience of working in a start-up culture with the large datasets and many other resources of an established company. You will also:

    • Develop and implement a strategy for continuous improvement of our Machine Learning Ops including versioning, testing, automation, reproducibility, deployment, monitoring, and data privacy
    • Develop and report on ML Ops metrics such as deployment frequency, lead time for changes, mean time to restore, and change failure rate
    • Collaborate with data scientists, data engineers, API engineers, and the dev ops team
    • Build scalable data ingestion and machine learning inference pipelines
    • Scale up production systems to handle increased demand from new products, features, and users
    • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
    • Automate and handle the life-cycle of the systems and platforms that process our data

    Requirements

    • Masters degree in Software Engineering, Data Engineering, Computer Science or related field
    • 5 years of relevant work experience
    • Strong Scala and Python background
    • Experience with Apache Spark and/or Ray
    • Knowledge of AWS, GCP, Azure, or other cloud platform
    • Knowledge of current principles and frameworks for ML Ops
    • Experience with ML Ops technologies such as ML Flow, DVC, Grafana, DataHub, Databricks
    • Experience with machine learning technologies such as PyTorch, TensorFlow, AWS Sagemaker
    • Experience with CI/CD pipelines, including Jenkins or Git Actions
    • Experience with Docker containerization or Kubernetes orchestration
    • Experience in improving data security and privacy, and managing and reducing cloud costs
    • Knowledge of API development and machine learning deployment

    Work in a way that works for you

    We promote a healthy work/life balance across the organization, with various flexible and remote working options available to employees

    Working with Us

    LexisNexis Legal & Professional is proud to be an equal-opportunity employer. We are committed to equal opportunity employment regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. Together, we are building a diverse and inclusive workplace.

    Working for you

    We believe in a healthy work/life balance. We know that your well-being and happiness are key to a long and successful career.

    About our Team

    LexisNexis is a data and analytics company with 10,500 colleagues serving customers in more than 150 countries. We're one of the largest information and analytics companies on the planet. We design solutions that help our customers increase productivity, improve decision-making and outcomes, and be more successful.

  • Dynamic Outsourced Solutions

    Data Engineer

    Found in: Trabajos Diarios ZA C2 - 6 days ago

    Dynamic Outsourced Solutions Cape Town, South Africa Permanent

    The data engineer is ultimately accountable for preparing and manipulating data for further analysis, including ETL and will support testing across the development lifecycle · The Data Engineer is responsible for extracting and transforming data from source systems, understandin ...

  • PBT Group

    Data Engineer

    Found in: Executive Placements ZA C2 - 2 days ago

    PBT Group Cape Town, South Africa

    We currently have numerous vacancies for Data Engineers skilled in tools such as the Microsoft Stack (SSIS, SSRS, SSAS), Power BI, AWS, Azure, DataStage, SAS etc. · Duties: · Design, develop, test and deploy ETL for ODS and data mart projects, as well as application and managemen ...

  • IOCO

    Data Engineer

    Found in: Executive Placements ZA C2 - 2 days ago

    IOCO Cape Town, South Africa

    We are seeking an experienced Data Migration Engineer to join our team on a contract basis to facilitate this migration process. The ideal candidates will have strong expertise in data engineering, particularly with Azure Synapse services, SSIS, and API integration. · What you'll ...

  • Dimension Data

    Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    Dimension Data Cape Town, South Africa temporary

    As a Data Engineer, you'll design and build the data architecture of our products. You will use your technical knowledge to help us develop new products by taking an idea from concept to reality. You'll work on projects across multiple teams in order to achieve company goals and ...

  • 60degrees

    Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    60degrees Cape Town, South Africa Permanent Full time

    Job Description · Data Engineer (Gauteng) · Compensation: R – R per annum · Working model: Hybrid · The opportunity that awaits you: · Our client, a solutions energy engineering solution provider with projects mainly in Sub-Saharan Africa seeks to expand their team. Our cl ...

  • DLK Group

    Data Engineer

    Found in: Talent ZA C2 - 2 days ago

    DLK Group Cape Town, South Africa Contract

    Job Description · Modifying the database structure, asnecessary, from information given by application developers. · Enrolling users and maintaining systemsecurity. · Controlling and monitoring user accessto the database. · Monitoring and optimizing the performanceof the databas ...

  • Armstrong Appointments

    IT Data Engineer

    Found in: Talent ZA 2A C2 - 5 days ago

    Armstrong Appointments Cape Town, South Africa

    Our client based in Cape Town are currently seeking the skills of an IT Data Engineer to assist in designing and implementing scalable and robust processes to support the data engineering capability. This role will be responsible for extracting and transforming massive amounts of ...

  • PBT Group

    Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group has a requirement for an intermediate Data Engineers skilled in AWS, SQL, Oracle, legacy systems, infrastructure, Cobol. · Duties: · Design, develop, test and deploy ETL for ODS and data mart projects, as well as application and management reports. · Provide technical s ...

  • Isilumko Staffing

    Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    Isilumko Staffing Cape Town, South Africa Full time

    Degree - Computer Science / Engineering / Informatics / Applied Mathematics / Statistics / Information Systems · Min 3-5 years with Microsoft BI Stack - SSIS, SSRS and T-SQL · MS SQL Server and Cloud Data Systems · Relational Database Management · Data modelling · Systems analysi ...

  • iSanqa

    Data Engineer

    Found in: Talent ZA C2 - 1 day ago

    iSanqa Cape Town, South Africa Full time

    Requirements · Solid 5+ years of experience with Azure Data Factory, Databricks, and Power BI. · Degree in Computer Science, IT, or a related field with a strong analytical focus. · Proficiency in Python, particularly in the context of data manipulation and notebook-based analyti ...

  • Cletech Recruitment

    Data Engineer

    Found in: Executive Placements ZA C2 - 2 days ago

    Cletech Recruitment Cape Town, South Africa

    Responsibilities:Configure and implement software, meeting asset managers research & investment process needs. · Develop end-to-end data service solutions, ensuring client data needs in financial markets are met. · Collaborate closely clients to provide support, enhance service ...

  • PBT Group

    DevOps Data Engineer

    Found in: Executive Placements ZA C2 - 2 days ago

    PBT Group Cape Town, South Africa

    PBT Group has a requirement for an intermediate DevOps Data Engineer. · Duties: · Strong experience with AWS, Terraform, CI/CD, Git · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in co ...

  • PBT Group

    AWS Data Engineer

    Found in: Executive Placements ZA C2 - 2 days ago

    PBT Group Cape Town, South Africa

    PBT Group has an opportunity for an AWS Data Engineer, preferably with Hadoop experience. · Duties: · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties - Spa ...

  • PBT Group

    DevOps Data Engineer

    Found in: Executive Placements ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa

    PBT Group has a requirement for an intermediate DevOps Data Engineer. · Duties: · Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Glue, Step-functions, K ...

  • PBT Group

    Data Streaming Engineer

    Found in: Talent ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group has an opportunity for a Data Streaming Engineer to build, enhance, and maintain real-time data pipeline. Work with various infrastructure and operations teams to maintain data infrastructure. As a senior engineer on the Data Streaming Platform team, you will be respons ...

  • PBT Group

    SQL Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group, leaders in Business Intelligence, has a vacancy for a Microsoft SQL Data Engineer. · Duties: · Plan and analyse complex business requirements and implement technology enabled solutions to address multi-discipline business opportunities/problems. · Conduct planning, ana ...

  • Kuda

    Intern Data Engineer

    Found in: beBee S2 ZA - 6 days ago

    Kuda Western Cape, Cape Town, South Africa Full time

    Kuda's job vacancy, Career and Recruitment · Job title : Intern Data Engineer (6 Months) jobs in Western Cape · Job Location : Western Cape, Cape Town · Deadline : May 16, 2024 · Quick Recommended Links · Jobs by Location · Job by industries · Learning Opportunities · Direct exp ...

  • PBT Group

    AWS Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    PBT Group Cape Town, South Africa Full time

    PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. · The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers ...

  • Hire Resolve

    Senior Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    Hire Resolve Cape Town, South Africa Full time

    Hire Resolve is currently seeking a highly skilled Data Engineer to join their client's internationally based team. Their Data Engineer will be based in Cape Town with the Data Team, who work on a hybrid work model. · Requirements · Bachelor's degree in Computer Science or a rela ...

  • IO Global

    Senior Data Engineer

    Found in: Talent ZA C2 - 3 days ago

    IO Global Cape Town, South Africa Full time

    Summary · IO Global (IOG), the creator of the Cardano blockchain platform, is searching for a Senior Data Engineer, preferably with a DeFi background. IOG is creating a spinout venture that combines crypto/Web3/DeFi innovations with traditional finance (TradFi) to make borrowing ...