Senior Data Engineer (Azure, Synapse)
Summary
Senior Data Engineer in Sydney designing end-to-end data pipelines, metadata-driven processing frameworks, and data quality/audit tooling on Azure Synapse with PySpark. Requires 7+ years in data engineering including leading technical initiatives, plus full Australian work rights; open to perm or contract.
Type: Full Time – Perm / Contract (Open)
Location: Sydney, AU
Status: AU valid visa with full work rights
Experience: 7+ years
Requisites:
- Experience in data engineering, including leading technical initiatives.
- Hands-on experience with Azure Synapse Analytics and PySpark.
- Design and implement end-to-end data pipelines and notebooks.
- Build and maintain metadata-driven data processing frameworks.
- Develop audit frameworks to track data processing and pipeline execution.
- Implement and maintain data quality rules and validation checks.
- Ensure data accuracy, consistency and reliability across data pipelines.
- Collaborate with business and technical teams to deliver data engineering solutions.