GCP Data Engineer
Posted 5
views
Summary
Senior data engineer building and delivering end-to-end data products on Google Cloud Platform for UK-based feature teams in Bristol or Manchester. Day to day involves dbt, Python and SQL pipelines, ETL/ELT and data modelling, master data management (MDM) architecture and integration, real-time data patterns, and DevOps, testing and governance through to production go-live.
In-scope technologies/products: | • Google Cloud Platform (GCP) and comparable cloud-based data engineering services • dbt • Python • SQL • ETL/ELT tooling and methodologies • Data modelling and data product development • AI-enabled data development • Testing and validation frameworks • Master Data Management (MDM), including commercial off-the-shelf and bespoke solutions • MDM integration and implementation • Real-time data product patterns • DevOps tooling and deployment practices |
Skillsets required: | • Expert-level GCP or cloud-based data engineering capability • Advanced practical experience of dbt, Python data engineering and SQL • Strong data modelling and ETL/ELT design skills • Proven end-to-end data product build experience • Experience applying AI-enabled approaches to data development • Strong testing, data validation and quality assurance capability • Data architecture expertise • MDM and enterprise data architecture experience, including strategy, solution selection, integration and implementation • DevOps, deployment, governance, and production go-live experience • Senior technical leadership capable of leading a multidisciplinary feature team |
Scope of services: | The requirement is for two UK-based feature teams, each comprising six resources and led by a Senior Lead Data Engineer. All team members must be based in Bristol or Manchester; London-based delivery
is specifically excluded. The teams are required to start immediately, and suppliers must propose resources who are available and capable of being onboarded without delay. • Improve the quality, richness, and consumption-readiness of FDP data. • Deliver FDPs end to end, from ODP selection through design, engagement and shaping, development, DevOps, testing, validation, governance, deployment and go-live. • Define and support MDM architecture and strategy. • Assess and implement commercial off-the-shelf MDM products where appropriate. • Design and develop bespoke MDM solutions. • Deliver MDM integration and implementation activities. • Design and implement real-time data product patterns. • Work within the applicable delivery, architecture, engineering, security and governance standards. • Provide experienced, delivery-ready practitioners; proposals based on academic exercises, speculative hiring or resources requiring extended mobilisation will not be accepted. |