Senior Data Engineer – Real-Time Pipelines on AWS
Summary
Senior data engineer (9-14 yrs) in Sydney building enterprise-scale data platforms on AWS: designing batch and real-time ingestion, optimizing pipelines, and delivering low-latency streaming with Kinesis/Kafka. Core stack: AWS, Python, PySpark, databases, CI/CD and IaC.
The Hr Ally is seeking an experienced Data Engineer (9-14 years) to join a high-performing team delivering enterprise-scale data platforms and real-time data solutions on AWS in Sydney.
You will design scalable batch and real-time data ingestion, optimize pipelines, and build low-latency streaming solutions using Kinesis or Kafka. The role demands strong AWS, Python, PySpark, and database expertise, with CI/CD and IaC know-how.