Kafka Engineer - Johannesburg, South Africa - IOCO

Description

Are you a skilled and experienced engineer with expertise in Kafka and real-time data streaming? We are looking for a dedicated Kafka Engineer to join our team and play a vital role in managing and optimizing our Kafka infrastructure.

What you'll do:

• Kafka:
  • Design, manage, and support Kafka-based data pipelines.
  • Design, manage, and support Kafka Connect data pipelines.
  • Design, manage, and support KSQLDB data pipelines.
  • Monitor and optimize Kafka clusters.
  • Troubleshoot any Kafka related issues.
  • Handle customer queries and support.
    
• Azure DevOps:
  • Develop, design, and manage deployment and build pipelines
  • Manage and support Git repositories.
  • Troubleshoot build and deployment pipeline-related issues.
  • Manage and support on-premises build agents.
  • Design, develop, manage, and support Docker images.
  • Design, develop, manage, and support Helm charts.
  • Troubleshoot Docker image build-related issues.
  • Troubleshoot Helm chart-related issues.
  • Troubleshoot Azure Container Registry-related issues.
  • Troubleshoot Azure DevOps build and deployment pipeline-related issues
  • Grafana and Prometheus.
  • Design, build, and publish dashboards to monitor microservices and Kafka.
  • Troubleshoot Grafana and Prometheus-related issues.
  • Handle customer queries and support.
    Kubernetes.
  • Manage and support deployments, stateful sets, ingresses, services, secrets, and persisted volumes.
  • Troubleshoot Kubernetes-related issues.
  • Monitor and optimize Kubernetes infrastructure.
  • Handle customer queries and support.

Qualification:

• Gr 12 or equivalent.
• Bachelor's Degree in a related field.
• Proven experience as a Kafka or DevOps Engineer or in a similar role.
• Other skills: Kafka Administration.