GCP Data Engineer
Summary
Senior GCP Data Engineer builds and optimizes scalable data pipelines and CI/CD workflows using BigQuery, Dataflow, and Kubernetes, ensuring security and cost efficiency.
An experienced and versatile Senior GCP Data Engineer with deep expertise in DevOps, CI/CD, Containerization, and advanced data engineering on Google Cloud Platform. The ideal candidate combines strong technical acumen with business engagement skills — capable of translating business requirements into scalable, production‑grade technical solutions.
- Design, build, and optimize data pipelines and ingestion frameworks using GCP services such as Dataflow, Pub/Sub, BigQuery, Cloud Storage, Cloudrun, and No‑SQL.
- Architect and implement end‑to‑end CI/CD pipelines for data workloads using templates, GitLab CI, ensuring automation and compliance with DevOps standards.
- Develop and manage containerized applications for scalable and resilient data services.
- Implement data quality, monitoring, and observability frameworks across pipelines.
- Translate complex business requirements into technical architecture, ensuring alignment with enterprise data strategy and governance.
- Ensure adherence to security, compliance, and cost optimization best practices in all GCP solutions.
Primary Skillset MUST HAVE:
- GCP (BigQuery, Dataflow, Pub/Sub, Composer, Cloud Functions, GCS, Cloud SQL, Firestore, and NoSQL design patterns).
- GitOps, Infrastructure as Code (Terraform, Deployment Manager), and automated testing in data pipelines.
- Deep understanding of Docker, Kubernetes, and microservice orchestration.
- Experienced in Scrum; familiar with story writing, backlog refinement, and sprint reviews.
Secondary Skillset & Softskills & Language requirements:
- Proficiency in Python, SQL, and Java (nice to have).