Senior Data Engineer
Posted 2
views
Summary
A senior contract data engineer, placed by recruiter Talent into a Victorian government agency, will migrate an existing SQL Server data warehouse and ETL pipelines to a modern Databricks and Azure environment. Day to day this means translating SQL warehouse structures, queries and ETL logic into Databricks notebooks, pipelines and workflows using SQL and Python.
- Contract until end of April 2027 – Government Agency
- Databricks, Python, SQL and Azure
We are seeking a Data Engineer – Databricks to join a major data platform migration program. You will play a hands‑on role in transitioning an existing SQL Server data warehouse and associated pipelines to a modern Databricks and Azure environment.
Key Responsibilities
Lead the migration of an existing SQL Server data warehouse and ETL environment into Databricks and Azure.
- Translate existing SQL warehouse structures, queries, stored procedures and ETL logic into scalable Databricks solutions.
- Build and develop Databricks notebooks, data pipelines and workflows using SQL and Python.
- Analyse existing SQL data and processes, identify migration requirements
- Support data validation, testing, optimisation and troubleshooting throughout the migration
Key Skills and Experience
- 10+ years of hands‑on experience as a Data Engineer.
- Strong hands‑on experience with Databricks, including data engineering, notebooks, workflows and pipelines.
- Advanced SQL skills, with proven experience working with data warehouses
- Strong Python development skills, particularly for building data pipelines
- Proven experience migrating SQL Server data warehouses, ETL processes or data platforms to Databricks or similar modern data platforms.
What’s in it for you:
- Contract until end of April 2027
- Government Agency