Senior Data Engineer: Streaming Pipelines on Spark/Azure
Summary
Design, build, and support modern batch and streaming data pipelines using Spark/PySpark, Kafka, and Azure Synapse in a hybrid, hands-on leadership role in Sydney.
Whizdom is seeking an experienced ADAPT Engineer in Sydney for a hands-on, leadership-focused role. You will design, build and support modern data platforms and pipelines, mentor teammates, and drive scalable data solutions across large initiatives in a hybrid working environment.
The role emphasizes end-to-end batch and near real-time processing, streaming with Kafka, and cloud-based data architectures using Azure Synapse and Spark/PySpark.