Senior Data Engineer: Azure Databricks Data Pipelines
Summary
A senior data engineer role supporting the ABARES Digital Transformation Program at Australia's Department of Agriculture, Fisheries and Forestry in Canberra. Day to day you build and optimise data pipelines in Azure Databricks using Python and SQL, with Azure Data Factory, Azure DevOps, CI/CD and Git for reliable automated deployment.
The Department of Agriculture, Fisheries and Forestry (DAFF) in Canberra is seeking a Data Engineer to support the ABARES Digital Transformation Program. You will build and optimise data pipelines in Azure Databricks, using Python and SQL to deliver scalable analytics solutions across multiple platforms.
Candidates should have hands-on experience with Azure Data Factory, Azure DevOps, CI/CD pipelines, and Git version control to ensure reliable, automated deployment and smooth collaboration with