Lead Data Engineer - Melbourne
Summary
Lead a team to design, build, and optimize scalable data pipelines and warehouses on Azure using SQL, Python, ADF, Databricks, and Synapse.
Ayan Infotech are urgently looking for a Lead Data Engineer for a long term contract job opportunity in Melbourne.
All applicants must have full unrestricted work rights in Australia.
Title: Lead Data Engineer Location: Melbourne Type: Contract (6-12 months+)
Required Skills and Experience:
- Strong expertise in SQL and Python (or similar programming languages).
- Deep experience with Azure Data Factory (ADF), Databricks, and Azure Synapse.
- Advanced knowledge of Data Modeling and Data Warehousing (DWH) concepts
- Hands‑on exposure to Microsoft Fabric ecosystem.
- Strong understanding of cloud data architecture and enterprise-scale solutions.
Key Responsibilities:
- Lead and own end-to-end data platform delivery, including design, build, and optimization of scalable data solutions on Azure. (derived from pipeline & engineering responsibilities).
- Architect and govern data pipelines, data models, and enterprise data platforms using Azure services.
- Provide technical leadership to data engineers, reviewing code, enforcing best practices, and ensuring quality delivery.
- Drive development of APIs, Azure Functions, and Python-based solutions aligned with business needs.
- Oversee cloud infrastructure management and ensure optimal performance, scalability, and cost efficiency.
- Define and implement data governance, data quality, and security standards.
- Establish and drive CI/CD, DevOps practices, and agile delivery frameworks across the data platform.
- Collaborate business and technical stakeholders, translating requirements into scalable solutions and roadmaps.
- Mentor team members and build capability within the data engineering team.
Experience
- 8+ years of experience in data engineering, with 2-4 years in a leadership role.
- Proven ability to lead cross‑functional teams and deliver complex data programs.
Preferred Skills
- Experience in building enterprise APIs and Azure Function Apps.
- Exposure to framework‑based development (proc frameworks or similar).
- Experience in stakeholder — …?.... ???
Contact: 02 9412 4178 for more details.
www.ayaninfotech.com