- Design and implement data pipelines within a big data architecture using Java, Python, Scala
- Analyze and migrate on-premise data warehouses to AWS cloud
- Operationalize analytical data infrastructure providing ad-hoc access to large datasets
- Collaborate with other teams to extract and load data from multiple sources
- Research and implement new big data technologies for enhanced capabilities
- Bachelor's Degree in Computer Science or relevant field
- Experience in Data Engineering roles with strong SQL knowledge
- Expertise in AWS services such as Redshift, Athena, S3
- Knowledge of data pipeline tools like Airflow, Luigi
- Familiarity with big data tools such as Hadoop, Spark, Kafka
- Proficient in scripting languages like Python, Java, Scala
AWS Data Engineer with DataBricks - Johannesburg, South Africa - PBT Group
Description
PBT Group is looking for a skilled AWS Data Engineer with DataBricks expertise to join their team. As an AWS Data Engineer, you will be responsible for designing, building, and operationalizing large-scale enterprise data solutions and applications using various AWS data and analytics services along with 3rd party tools such as Spark, DynamoDB, RedShift, and more.
Key Responsibilities:
Requirements:
If you are passionate about working with cutting-edge technologies and driving innovation, this role is perfect for you. Join PBT Group and be part of a dynamic team that values collaboration and continuous learning.