Senior GCP Data Engineer
Posted
Summary
TCS is hiring a Senior GCP Data Engineer (6-10 years' experience) based in Hyderabad or Bangalore to design, build, and optimize large-scale batch and streaming data pipelines on Google Cloud - BigQuery, Dataflow/Beam, Dataproc, Cloud Composer (Airflow), and Pub/Sub - using Python, SQL, Terraform, and CI/CD tooling.
- Dear Professionals,
- Greetings from Tata Consultancy Services (TCS)!!!
- Job Title : Senior GCP Data Engineer
- Experince : 6-10 Years
- Location: Hyderabad/Bangalore
- Mode of Interview : Virtual
- Expert-level knowledge of Google Cloud Platform services including:
- BigQuery – advanced SQL, partitioning, optimization, and cost control
- Dataflow (Apache Beam) – large-scale batch and streaming data pipelines
- Dataproc – Spark and Hadoop-based distributed processing
- Cloud Composer (Airflow) – workflow orchestration, scheduling, and dependency management
- Pub/Sub – event-driven, real-time ingestion
- Cloud Storage (GCS) – data lake setup, lifecycle management, access control
- Strong proficiency in Python (Pandas, PySpark, Beam SDK) and SQL for data wrangling and transformation.
- Expertise in ETL/ELT design, data lake/data warehouse/lakehouse architecture.
- Experience with DevOps & CI/CD using tools such as GitHub Actions, Jenkins, or Cloud Build.
- Hands-on with Terraform or Deployment Manager for Infrastructure as Code (IaC).
- Solid understanding of GCP IAM, VPC, security policies, and encryption mechanisms.
- Familiarity with data quality, metadata, lineage, and cataloging tools (e.g., Data Catalog).
- Proficiency in cost governance, performance tuning, and resource monitoring (Cloud Monitoring/Logging).
- Knowledge of modern data frameworks and data integration between systems like Kafka, Snowflake, or Looker.