GCP Data Engineer - SME
Summary
A subject-matter-expert GCP Data Engineer role owning large-scale cloud data engineering: designing ingestion from a data lake into GCP, building automated ETL pipelines, and optimising BigQuery SQL and data models for low latency at massive scale. Core stack is GCP (BigQuery, Cloud Storage, Pub/Sub, Kubernetes, Cloud Functions, IAM) plus orchestration tooling and infrastructure as code.
Take ownership of large scale cloud data engineering within one of the most advanced GCP environments in the industry. If you enjoy solving complex technical challenges around low latency, massive throughput and high availability this role will give you the freedom to shape the future of cloud data architecture at serious scale.
You are a GCP Data SME, ready to guide the design and delivery of next generation data solutions. You will join a highly skilled data engineering group that is driving the evolution of a sizeable data platform. The platform supports real time insight and business critical decisions, making your work essential to the company’s performance . The environment is growing quickly and presents the sort of technical problems that only appear when millions of events move through the systems every second.
You will bring deep hands-on experience across GCP in particular BigQuery together with a strong knowledge of data modelling, orchestration tooling and infrastructure as code. You will be confident working with services such as Cloud Storage, Pub Sub, Kubernetes, Cloud Functions and IAM and you will understand how to build secure and well governed environments.
You will take responsibility for defining the way data is ingested from the data lake into GCP and you will shape how it is processed, stored and analysed in BigQuery. You will craft and optimise complex SQL commands and deliver data models that must remain highly performant even when workloads surge. You will mentor teams on best practice and act as the subject matter expert for BigQuery architecture security and governance.
You will take ownership of automated pipelines for ingestion transformation and loading and you will work to ensure accuracy, consistency and reliability across a large and evolving platform. You will collaborate with architects, engineering leads and application developers to ensure that every solution is scalable, resilient and fully compliant.
A few years ago, every security vendor suddenly became a cloud security vendor.