Senior Data Engineer (Dev Background)
Posted
Summary
Senior Data Engineer on a 6-month rolling contract at a high-volume consumer business in Melbourne, building large-scale AWS and Databricks data pipelines, writing complex SQL transformations, and working on Kafka/MSK streaming as part of a global AWS migration. Hybrid, 3 days/week in Melbourne CBD; full Australian working rights required.
Our client is a high volume, real time consumer business in Melbourne. They’re in the middle of a major global AWS data migration and are looking for engineers to get stuck in!
The gig
- 6-month rolling contract (most of the team have been there for years)
- Hybrid, 3 days a week in the Melbourne CBD
- Must have full working rights
What you’ll be doing
- Building and optimising large-scale data pipelines on AWS and Databricks
- Writing heavy SQL transformation: complex joins and business logic, not just landing data and basic cleansing
- Working on streaming pipelines with Kafka / MSK
- Contributing to a large, global migration program
What you’ll bring
- Strong, current Databricks experience
- AWS data services (Glue, Redshift, Athena, EMR, Kinesis, MSK, Lake Formation)
- Advanced SQL, with real depth in complex transformation
- Kafka / MSK streaming in production
- Proven enterprise data migration experience
Nice to have
- Python
- Power BI and ETL tooling
- Mix of batch and streaming experience