GCP Data Engineer
Summary
Build scalable data platforms and ETL/ELT pipelines on Google Cloud Platform using BigQuery, PySpark, Cloud Composer, Dataflow, Pub/Sub, Python, and SQL.
TCS is Hiring GCP Data Engineer
Location: Bengaluru
Experience: 5+
Face to Face Interview on 22nd August at Tata Consultancy Services, Yeshwanthpur Industrial Suburb, Yeswanthpur, Bengaluru, Karnataka
Role Summary
We are looking for a GCP Data Engineer with strong expertise in building scalable data platforms and modern data pipelines on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience with BigQuery, PySpark, Cloud Composer (Airflow), Dataflow, Pub/Sub, Python, and SQL to support enterprise data engineering and analytics initiatives.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines on GCP.
- Build and optimize batch and real-time data processing solutions.
- Develop data ingestion frameworks using BigQuery, GCS, Pub/Sub, and Dataflow.
- Create orchestration workflows using Cloud Composer (Apache Airflow).
- Develop data transformation logic using PySpark, Python, and SQL.
- Build and maintain data lakes, data warehouses, and analytics-ready datasets.
- Implement data quality, monitoring, governance, and security frameworks.
- Optimize BigQuery performance, partitioning, clustering, and query execution.
- Collaborate with BI, Analytics, Data Science, and business stakeholders.
Must-Have Skills
- Google Cloud Platform (GCP)
- BigQuery
- PySpark
- Python
- SQL
- Cloud Composer (Airflow)
- Google Cloud Storage (GCS)
- Pub/Sub
- Dataflow
- ETL / ELT Development
- Data Modeling
- Data Warehousing Concepts