Data Engineering Lead - Insurance
- Data Engineering Lead - New headcount
- Healthcare projects
Leading insurance firm
Job DescriptionAs a Data Engineering Lead, your main responsibilities will include:
- Collaborate closely with Health business leaders, product owners, regional teams, and IT stakeholders to gather business requirements, define project scope, and drive successful delivery within agreed timelines.
- Partner with regional teams to align data initiatives, priorities, and implementation strategies across multiple markets.
- Perform effort estimation and project planning, translating complex business requirements into technical epics, user stories, and delivery roadmaps.
- Design, develop, and maintain scalable data platforms, including batch and real-time data pipelines, data lakehouses, and enterprise data warehouse solutions.
- Provide technical leadership for enterprise data environments, establishing architecture standards, engineering best practices, and platform optimization strategies across Azure Cloud and Databricks.
- Build and enhance data ingestion, orchestration, transformation, and data quality frameworks to ensure reliable and efficient data processing.
- Drive data governance, technical standards, and best practices to maintain data integrity, security, and compliance.
- Lead code reviews, technical troubleshooting, performance tuning, and cost-optimization initiatives to ensure robust and resilient data solutions.
A successful Data Engineering Lead should have:
- Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related discipline.
- Minimum 8 years of IT experience, including at least 5 years in data engineering leadership, technical lead, or solution delivery roles.
- Strong hands-on experience with Azure technologies, including Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Synapse Analytics, and Azure SQL.
- Deep expertise in Azure Databricks, Apache Spark (PySpark/Spark SQL), and modern ETL/ELT framework design and implementation.
- Solid experience with relational database technologies such as Oracle, SQL Server, or PostgreSQL.
- Proven ability to lead large-scale data platform initiatives and communicate complex technical concepts effectively to both technical and non-technical stakeholders.
- Familiarity with Alibaba Cloud (AliCloud) big data technologies, including DataWorks, MaxCompute, OSS, and Hologres, is highly desirable.
- Experience with data visualization and reporting tools such as Power BI, FineBI, Tableau, or similar enterprise BI platforms.
- Strong analytical, stakeholder management, and problem-solving skills, with the ability to work effectively in a fast-paced and collaborative environment.
Skills
- Analytics
- Azure
- Azure Data Factory
- Azure Synapse
- Big Data
- Cloud
- Data Engineering
- Data Governance
- Data Ingestion
- Data Lake
- Data Pipelines
- Data Quality
- Data Visualization
- Data Warehousing
- Databricks
- ELT
- ETL
- Oracle
- PostgreSQL
- Power BI
- PySpark
- RDBMS
- Spark
- SQL
- SQL Server
- Stakeholder Management
- Tableau
- User Stories