Data Engineering Lead - Insurance
Posted 3
views
Summary
Lead data engineering for a leading insurance firm's health business in Hong Kong: design and build scalable data platforms (batch/real-time pipelines, lakehouses, warehouses) on Azure and Databricks, set architecture standards, and drive delivery across regional teams.
- Data Engineering Lead - New headcount
- Healthcare projects
About Our Client
Leading insurance firm
Job Description
As a Data Engineering Lead, your main responsibilities will include:
- Collaborate closely with Health business leaders, product owners, regional teams, and IT stakeholders to gather business requirements, define project scope, and drive successful delivery within agreed timelines.
- Partner with regional teams to align data initiatives, priorities, and implementation strategies across multiple markets.
- Perform effort estimation and project planning, translating complex business requirements into technical epics, user stories, and delivery roadmaps.
- Design, develop, and maintain scalable data platforms, including batch and real-time data pipelines, data lakehouses, and enterprise data warehouse solutions.
- Provide technical leadership for enterprise data environments, establishing architecture standards, engineering best practices, and platform optimization strategies across Azure Cloud and Databricks.
- Build and enhance data ingestion, orchestration, transformation, and data quality frameworks to ensure reliable and efficient data processing.
- Drive data governance, technical standards, and best practices to maintain data integrity, security, and compliance.
- Lead code reviews, technical troubleshooting, performance tuning, and cost-optimization initiatives to ensure robust and resilient data solutions.
The Successful Applicant
A successful Data Engineering Lead should have:
- Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related discipline.
- Minimum 8 years of IT experience, including at least 5 years in data engineering leadership, technical lead, or solution delivery roles.
- Strong hands-on experience with Azure technologies, including Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Synapse Analytics, and Azure SQL.
- Deep expertise in Azure Databricks, Apache Spark (PySpark/Spark SQL), and modern ETL/ELT framework design and implementation.
- Solid experience with relational database technologies such as Oracle, SQL Server, or PostgreSQL.
- Proven ability to lead large-scale data platform initiatives and communicate complex technical concepts effectively to both technical and non-technical stakeholders.
- Familiarity with Alibaba Cloud (AliCloud) big data technologies, including DataWorks, MaxCompute, OSS, and Hologres, is highly desirable.
- Experience with data visualization and reporting tools such as Power BI, FineBI, Tableau, or similar enterprise BI platforms.
- Strong analytical, stakeholder management, and problem-solving skills, with the ability to work effectively in a fast-paced and collaborative environment.