Data engineer in health research
Posted 4
views
Summary
Data Engineer building secure, high-quality data pipelines on an Azure-based platform for large-scale health research, curating NHS and healthcare datasets into research-ready assets. Core work is ETL and transformations in Python and PySpark, code reviews, and documentation, with possible use of Databricks, Dagster, and Kubernetes.
Описание
We're creating a data platform that enables cutting‑edge health research at unprecedented scale. As a Data Engineer, you'll play a critical role in designing and building the secure, high‑quality data pipelines that power research used by scientists and healthcare innovators around the world.
Задачи
- Building and maintaining data pipelines across our Azure-based platform
- Translating technical specifications, architecture designs, and Jira tickets into secure, scalable implementations
- Developing data transformation and ETL processes using Python and PySpark
- Working with healthcare and NHS datasets to curate trusted, research‑ready data assets
- Reviewing and approving code through pull requests, ensuring consistency, quality, security, and adherence to engineering standards
- Collaborating with researchers, engineers, and stakeholders to understand requirements and deliver solutions
- Identifying risks, challenging assumptions, and asking the right questions to improve designs before implementation
- Producing documentation, source‑to‑target mappings, and supporting technical standards across the platform
- Contributing to best practices in data engineering, security, governance, and cloud architecture
Требования
- Proven experience building production‑grade data pipelines and ETL processes
- Excellent Python skills with experience developing scalable data solutions
- Experience working with PySpark or distributed data processing frameworks
- Experience using GitHub and modern software engineering practices
- Understanding of cloud‑based data platforms, ideally Azure
- Experience working with sensitive or regulated data and knowledge of secure data handling principles
- Ability to review technical designs and architecture documents and translate them into practical implementations
- Excellent problem‑solving skills and an ability to challenge requirements constructively when needed
- Experience conducting code reviews and maintaining engineering standardsExcellent stakeholder management and communication skills
- Будет плюсом: Experience working with NHS or healthcare datasets; Knowledge of healthcare coding systems and standards such as SNOMED CT, ICD, or READ codes; Experience with Databricks; Experience with Kubernetes; Experience using Dagster or other workflow orchestration platforms; SQL and data modelling experience; Understanding of metadata management and data governance frameworks
Условия
Salary from £62,000 per annum. We are interested in applications from people with a range of experience for this role
- Generous Pension Scheme - We invest in your future with employer contributions of up to 12%
- 30 Days Holiday + Bank Holidays - Enjoy a generous holiday allowance with the flexibility to take bank holidays when it suits you
- Enhanced Parental Leave - Supporting you during life's biggest moments
- Cycle to Work Scheme - Save 25-39% on a new bike and accessories through salary sacrifice
- Home & Tech Savings - Get up to 8% off on IKEA and Currys products, spreading the cost over 12 months through salary sacrifice
- £1,000 Employee Referral Bonus - Know someone amazing? Get rewarded for bringing them on board!
- Wellbeing Support - Access to Mental Health First Aiders, plus 24/7 online GP services and an Employee Assistance Programme for you and your family
- A Great Place to Work - We have a lovely Central London office in Holborn, and offer flexible and remote working arrangements