Data Platform Senior Engineer (SEL & SWL) x2
Summary
Senior data platform engineer designing, building and optimising data pipelines and analytical data models (dimensional, Lakehouse, Data Vault) for London health data using Microsoft Fabric, Snowflake and Azure, with ETL/ELT orchestration, CI/CD and data quality practices supporting NHS analytics, decision-making and ML.
As a Data Platform Engineer, you will design, build, and optimize modern data pipelines and analytical data models for health data across London. You’ll work with cross-functional teams to deliver secure, scalable data solutions that support analytical delivery and decision-making. You’ll evolve ingestion, transformation, and数据 modelling practices using Microsoft Fabric, Snowflake, and Azure, turning complex requirements into production-quality data products. Your work directly impacts Population Health Management and strategic commissioning. This role offers hands-on engineering with measurable impact in a dynamic NHS setting.
Responsibilities- Design, build and optimize scalable data pipelines from source to curated data products
- Develop data orchestration, transformation and integration solutions with automated ETL/ELT processes
- Create robust analytical data models (Dimensional, Lakehouse, Data Vault, semantic)
- Automate manual processes to boost productivity and reduce analyst intervention
- Implement modern engineering disciplines: Git, CI/CD, automated testing, monitoring, IaC
- Ensure data quality, reliability, validation, reconciliation, monitoring and backfill
- Contribute to performance, scalability, and efficient resource use across Fabric, Snowflake, and Azure
- Support Analytics, Data Science and AI by enabling pipelines for ML solutions
- Collaborate with analysts, scientists and stakeholders to solve real analytical problems
- Demonstrate measurable improvements in processing time, data quality and delivery
- Experience designing, building, testing and maintaining modern data pipelines and analytical data models
- Knowledge of data lifecycle: ingestion, orchestration, transformation, modelling, deployment, monitoring, optimization
- Proficiency with Microsoft Fabric, Snowflake, Azure; OneLake; Lakehouse architectures
- ETL/ELT tooling and orchestration (Airflow, Data Factory, Fivetran, Matillion)
- Dimensional modelling, Data Vault, data lineage, data quality, MLOps
- Git, CI/CD, IaC, automation, testing, monitoring
- Security governance, encryption, GDPR, data masking/tokenisation
- Experience with large-scale data, near real-time feeds, performance tuning
- Strong communication abilities to explain technical concepts to non-technical stakeholders
- NHS context and governance considerations a plus
- collaborative
- problem-solving
- clear communication
- Microsoft Fabric
- Snowflake
- Azure