GCP Data Engineer
Summary
Designs, builds, and maintains scalable batch and streaming data pipelines on Google Cloud Platform using BigQuery, Dataflow (Apache Beam), Cloud Composer, Cloud Spanner, GCS, and DBT, with Python, Java, SQL, and Kafka. Role seeks 5-12 years of experience with immediate joiners preferred.
ob Title: GCP Data Engineer
Experience: 5-12 Years
Location: Chennai
Joining Preference: Immediate Joiners
Job Description
We are looking for an experienced GCP Data Engineer with strong expertise in designing, developing, and maintaining scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate should have hands-on experience with BigQuery, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT, Python, SQL, and ETL processes. Experience in building batch and streaming data solutions using Kafka and Apache Beam (Dataflow) is essential.
Required Skills
- Strong programming skills in Python and Java
- Hands-on experience with GCP services: BigQuery, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT
- Expertise in Apache Beam (Dataflow) and ETL development
- Strong knowledge of SQL and data engineering concepts
- Experience with Kafka (Batch & Streaming)
- Knowledge of database replication and Message-Based CDC
- Good understanding of data modeling, scalability, and security
- Experience with Apache Airflow
- Exposure to Jenkins, GitHub, and Terraform is desirable
Keywords (Minimum 3 Must Match)
- GCP BigQuery
- Python
- ETL / SQL
- Google Cloud
Good to Have
- GCP Data Engineer Certification
Key Responsibilities
- Design and build scalable ETL/ELT pipelines on GCP.
- Develop and optimize data processing workflows using Dataflow and BigQuery.
- Implement batch and streaming solutions leveraging Kafka and Apache Beam.
- Ensure data quality, security, performance, and scalability across platforms.
- Collaborate with cross-functional teams to deliver enterprise data solutions.
Provide your feedback on BizChat