Technical Lead - Data Engineering
Summary
Lead a team to design and build scalable data pipelines on Azure Databricks for AIA’s insurance and financial services, focusing on ETL, data quality, and cloud best practices.
Overview
Technical Lead – Data Engineering (Azure Databricks) – AIA Australia. The role reports to the Head of Data Platforms and Analytics and can be based in Sydney or Melbourne. The position is part of a large technology, data, and business transformation program focused on building a modern platform using Azure Databricks.
Responsibilities
- Define detailed technical solutions and manage delivery of the data engineering team (onshore and offshore) based on business requirements and high‑level architecture.
- Design, build, and maintain scalable, efficient data pipelines and frameworks using Azure Databricks for ingestion, curation, and transformation of data.
- Lead data modelling, ETL automation, DevOps, data quality, security, and performance optimisation using best practices on Azure.
- Collaborate with key stakeholders across business, analytics, IT, and vendors to align engineering efforts with business priorities.
- Mentor and coach a team of data engineers and analysts, promoting best engineering practices and upskilling in the Azure Databricks toolset.
Qualifications
- Extensive experience in data design and engineering, preferably within insurance, banking, or financial services.
- Hands‑on experience developing data engineering and architecture frameworks using Databricks, data modelling, and ETL automation.
- Proficiency in programming languages and tools such as Python and SQL.
- Experience with Azure cloud services (ADF, ADLS, Azure SQL).
- Strong problem‑solving skills and the ability to analyse complex technical issues.
- Excellent communication skills, able to convey technical concepts to both technical and non‑technical audiences.
- Strong leadership skills, including mentoring and developing high‑performing teams.
- Databricks certification is highly regarded.
- Knowledge or experience in the insurance industry is highly regarded.
Benefits
- Access to training and development programs to build on current skills.
- Career development opportunities through internal mobility.
- Work with a purpose‑driven company that supports well‑being initiatives and additional leave days.
- Flexible working arrangements.
- Inclusive and supportive working environment.