Summary
Senior Data Engineer based in Cape Town who designs, builds, and optimises cloud data pipelines and lakehouse platforms (AWS/Azure/GCP — Redshift, Synapse, BigQuery, Databricks), streams data with Kafka/RabbitMQ, applies IaC and CI/CD, and mentors junior engineers.
* Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field (Master’s preferred).* 5+ years of experience in data engineering or related roles.* Relevant certifications (e.g., AWS Certified Data Analytics Specialty, Microsoft Certified: Azure Data Engineer, or Databricks Certified Data Engineer).* Strong expertise in SQL, including querying, optimization, and writing stored procedures.* Proven experience in cloud-based data platforms such as AWS Redshift, Azure Synapse, or Google BigQuery.* Knowledge of cloud lake house technologies (e.g., Delta Lake, Apache Iceberg, or Apache Hudi).* Hands-on experience with streaming platforms such as Kafka or RabbitMQ.* Expertise in data modelling for both on-premises and cloud-based systems.* Proficiency in Python, Java, or Scala for data engineering tasks.* Experience with CI/CD practices for data pipelines in a cloud environment.* Familiarity with data governance and security best practices in cloud environments.* Strong leadership and mentoring skills, with experience guiding junior team members.* Experience with big data technologies such as Hadoop, Spark, or Flink, especially in a cloud context.* Knowledge of containerization tools like Docker and orchestration platforms such as Kubernetes.* Expertise in monitoring and observability tools for cloud data pipelines.* Certification in cloud platforms or lake house technologies (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer).* Background in implementing real-time analytics and event-driven architectures in the cloud.* Understanding of cost optimization strategies for cloud-based data infrastructure.* Experience in managing hybrid environments during migration from on-prem to cloud.* Hands-on experience with serverless computing in cloud such as Lambda Functions.* Hands-on experience with cloud analytics platforms such as Big Query or Databricks* Proficiency in C# for general engineering tasks.* Hashicorp Terraform for IaC workloads* Automation using shell scripts (Powershell, Bash etc)* We’re dedicated to your supergrowth. Our comprehensive learning and development programmes give you a range of resources and opportunities to expand your skills and advance your career.* Your hard work and achievements won’t go unnoticed. Our innovative Performance Tool ensures you receive regular, constructive feedback, helping you to continuously improve and reach your full potential.* Our Employee Assistance programme offers a variety of benefits which you and your family can benefit from.* Free Daily Meal* Free Massages On-site* Free On-Site Gym* Group Life Cover* Funeral Fund Benefit* Financial Services Assistance* Employee Assistance Programme* Curro School Fees Benefit* Income Continuation Benefit* Leadership Training* Referral Bonus* Medical Aid Subsidy* Free Sleep Coaching* On-site Barista* Retirement Annuity Subsidy* Team socials
#J-18808-Ljbffr