Lead Azure Data Engineer

Job Description

• 12 + 12 + 12-month contract with a key Commonwealth Government agency
• Canberra based role with hybrid working arrangements
• NV1 security clearance preferred
• Lead Azure and Databricks data solutions for a Commonwealth Government agency

Resolve Recruit is partnering with a leading Commonwealth Government agency to find a Lead Azure Data Engineer. Our client uses modern cloud technology, including Azure and Databricks, to prepare data that supports decision-making and operational analytics across the organisation. This is a chance to shape the design, development and testing of data movement, transformation and visualisation processes that make a real difference.

In this role, you will work alongside a multidisciplinary team in an Agile environment, bringing your technical expertise, initiative and collaborative approach to every project.

Key Responsibilities

• Design, build and maintain ETL and ELT data ingest and transformation solutions to meet current and emerging needs
• Create and maintain automated ingest and transformation patterns and frameworks
• Prepare data in formats such as Parquet and Delta to support advanced analytics and AI use cases
• Develop and test data visualisations in Power BI that present complex information clearly for different audiences
• Collaborate with project and multidisciplinary teams to deliver outcomes aligned with organisational priorities
• Support and mentor data engineers through regular quality reviews and constructive feedback

Key Experience and Skills

• Demonstrated experience developing ETL/ELT processes for complex or large-scale data movement, transformation or visualisation, particularly in cloud environments
• Experience preparing data optimised for query performance in cloud compute engines, such as Spark, graph databases or Azure SQL
• Experience with engineering, storage and analytics services in the cloud, including Azure Data Factory, SQL Server Integration Services, Databricks, SQL Server, Data Lake Storage, Azure Machine Learning and ArcGIS Enterprise
• Familiarity with DevOps and Visual Studio, and with sourcing data from systems such as Oracle, Ingres and SQL Server (knowledge of Data Lakes and Lakehouses is highly regarded)
• Relevant qualifications or training in data engineering techniques, and around five years' experience as a data engineer
• Clear communication, relationship-building and negotiation skills, with a collaborative, adaptable approach

Security Requirements

Applicants will ideally hold a minimum Negative Vetting Level 1 Security Clearance (or higher) to be considered.

#J-18808-Ljbffr