Senior Data Engineer — Metadata-Driven Data Platform
Summary
Perch Group is hiring a Senior Data Engineer to industrialise its data platform with metadata-driven, configurable frameworks that replace bespoke pipelines. Day to day you design reusable patterns and orchestration for ingestion, transformation and publishing, working with Azure Data Factory, Databricks and Delta Lake in a regulated environment.
Perch Group is seeking a Senior Data Engineer to industrialise our data platform with metadata-driven, configurable frameworks. You will design reusable patterns, templates and orchestration to replace bespoke pipelines, while embedding automation and governance across pipelines.
You will work on ingestion, transformation, and publishing using Azure Data Factory, Databricks, and Delta Lake, shaping enterprise data models and DW architecture in a regulated, growth-focused environment.