Lead Data Engineer - Azure & Databricks (Hybrid Canberra)
Summary
Lead Data Engineer on a long-term contract, hybrid in Canberra: hands-on ETL/ELT pipeline development on Azure (ADF, Databricks, Data Lake) with Spark optimization, sourcing data from Oracle/Ingres/SQL Server, preparing Parquet/Delta data, using Azure DevOps and building Power BI visualisations.
IT Alliance is seeking a Lead Data Engineer in Canberra, Australia, for a long-term contract. The role focuses on hands-on ETL/ELT development, Azure-based data engineering (ADF, Databricks, Data Lake), Spark optimization, and robust data delivery pipelines.
The candidate will source data from Oracle/Ingres/Azure/SQL Server, prepare data using Parquet/Delta, and leverage Azure DevOps and Power BI to build meaningful visualisations.