Senior Cloud Data Platform Engineer
Summary
Build and maintain a large-scale GCP data platform with BigQuery, Terraform, and monitoring tools like Dynatrace, while supporting Spark workloads and CI/CD pipelines.
We are seeking a Senior Cloud Data Platform Engineer to support the build and ongoing maintenance of a large scale data platform running on Google Cloud Platform. This role sits within a data engineering environment where reliability, observability and infrastructure as code are core priorities. You will work on production systems handling complex data pipelines and cloud architecture at scale.
Responsibilities:
- Design, build and maintain data platform infrastructure on GCP, including BigQuery, GCS, IAM and Cloud Run.
- Implement and manage enterprise monitoring using Dynatrace to track data pipeline health, data quality and infrastructure performance.
- Write, refactor and manage stateful Terraform deployments in production environments.
- Build and maintain CI/CD workflows using GitHub Actions.
- Support and troubleshoot JVM based applications, including Spark workloads, running on cloud infrastructure.
- Maintain and improve Linux based systems, Docker containers and Bash automation scripts across the platform.
Key Skills and Experience:
- Experience building, scaling and maintaining complex systems.
- Experience building data platforms or complex cloud architectures, GCP strongly preferred.
- Hands on experience setting up enterprise monitoring with Dynatrace.
- Experience with Terraform in production environments.
- Strong expertise in GitHub Actions and Workflows.
- Deep expertise in GCP services including BigQuery, GCS, IAM, Cloud Run and networking.
- Strong Linux, Docker and Bash scripting skills.
- Experience managing JVM applications, ideally Spark.
- Familiarity with fundamental data science and data engineering concepts.