Data Engineer: Real-time Pipelines & Scalable Data
Summary
Data engineer in Cape Town with 3-4 years' experience who designs and maintains robust data pipelines for real-time and batch processing, ensuring data accuracy and reliability. Core stack: SQL, Python/Java, cloud services, Kafka/RabbitMQ streaming, ETL workflows, plus Spark/Hadoop and JSON/Parquet formats.
Digital Outsource Services in Cape Town seeks a data engineer with 3-4 years of experience to design and maintain robust data pipelines. You will work with SQL, Python/Java, and cloud services to ensure data accuracy and reliability across real-time and batch processing, leveraging Kafka/Rabbit MQ for streaming and ETL workflows.
Applicants should have a Bachelor’s degree in a related field, familiarity with Spark/Hadoop, and data formats like JSON/Parquet.