Data Engineer
Posted
Summary
Lead Data Engineer on a long-term contract (12 months + 24-month extension) with a Federal Government client in Canberra via IT Alliance, working hybrid (3 days office/2 days home). Day-to-day: building large-scale ETL/ELT ingestion and transformation pipelines on Azure (ADF, Databricks, Data Lake, SQL Server), optimizing with Spark, and visualizing data in Power BI. Baseline security clearance re
One of our Federal Government Clients is seeking to engage a Lead Data Engineer. This is a long-term contractual position.
Please check below all the job details
Contract Duration: 03 Years (12 months initially + 24 months extension)
Work Location: Canberra (03 Days office/02 Days home per week)
Eligibility: You must need to have Baseline Security Clearance or above.
Position Description
- Strong hands-on ETL/ELT development for complex/large-scale data ingestion and transformation.
- Strong Azure experience, particularly Azure Data Factory (ADF), Databricks, SQL Server and/or Azure Data Lake.
- Spark / distributed computing and optimisation of data for cloud query performance.
- Building automated data ingestion and transformation pipelines/frameworks.
- Data preparation using Parquet and/or Delta formats.
- Experience sourcing/integrating data from Oracle, Ingres, Azure and SQL Server.
- Experience across cloud data engineering, storage and analytics services.
- Azure DevOps / Visual Studio development environment.
- Power BI – ability to analyse complex datasets and develop meaningful visualisations.
- Highly desirable: Strong hands-on ADF + Databricks, Data Lake/Lakehouse architecture, Azure Machine Learning and/or ArcGIS Enterprise.