Data Engineer: Azure + Databricks Pipelines for Impact
Posted Updated
Description
Anglian Water Services is seeking a Data Engineer to design, build, and manage data platforms and pipelines across a major UK infrastructure programme. You’ll collaborate with partners like Microsoft, Databricks, and Cambridge/Cranfield Universities to unlock data value for improving project delivery and performance.
Based in the East of England, you’ll work on end-to-end data engineering, from ingestion to governance, enabling trusted analytics and reporting across hundreds of capital projects.
Design, build, and maintain scalable data pipelines in Azure and Databricks. Ingest, transform, and integrate data from multiple sources. Manage enterprise data architecture using Bronze/Silver/Gold medallion frameworks. Ensure data quality, governance, and traceability across assets. Support reporting and analytics by providing trusted data. Manage APIs and integrations between key systems. Create data lineage models, architecture diagrams, and metadata standards. Monitor and troubleshoot data issues to ensure reliable delivery. Support CI/CD practices and data product industrialisation. Develop proofs-of-concept and MVPs to solve business challenges. Collaborate with analysts, data scientists, and stakeholders to deliver value. Minimum of 2 years experience in data engineering. Experience designing and developing data pipelines, ETL processes and data integration solutions. Strong knowledge of Microsoft Azure data services and Databricks. Experience working with data lakes, data warehouses, and cloud data architectures. Understanding of data modelling, metadata management, data lineage, and governance principles. Experience using SQL and other data engineering technologies. Knowledge of CI/CD principles in data engineering environments. Experience managing APIs and integrating data across multiple systems. Strong analytical and troubleshooting skills for data quality and reliability. Ability to communicate technical concepts clearly to varied audiences. Collaborative mindset and a passion for continuous learning. Personal private health care Life cover – 8x annual salary 26 days holiday + bank holidays Flexible working opportunities Competitive pension – 7% match Bonus scheme and lifestyle benefits Training and development opportunities Subject matter expert roleSkills
Sign in to read and join the discussion.