Gcp Data Engineer
Posted Updated 25
views
Summary
Designs, builds, and maintains scalable data pipelines on Google Cloud Platform: writing optimized BigQuery SQL, developing Python ETL/ELT jobs, and running batch and real-time processing with Cloud Storage, Dataflow, Pub/Sub, and Cloud Composer. Hybrid role in Pune for engineers with 4+ years of experience.
Job Description GCP Data Engineer (BigQuery & Python)
Experience: 4+ Years (Flexible)
Location: Pune
Work Mode: Hybrid
Skills: Google Cloud Platform, BigQuery, Python, SQL
Job Summary
We are looking for an experienced GCP Data Engineer with strong expertise in Google Cloud Platform, BigQuery, Python, and SQL to design, develop, and maintain scalable data engineering solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines on Google Cloud Platform.
- Develop and optimize complex SQL queries using BigQuery.
- Build ETL/ELT pipelines using Python.
- Work on data ingestion, transformation, cleansing, and validation.
- Implement batch and real-time data processing solutions.
- Optimize BigQuery performance, partitioning, clustering, and cost.
- Work with Cloud Storage, Dataflow, Pub/Sub, and Cloud Composer.
- Ensure data quality, security, and reliability.
- Collaborate with data analysts, architects, and business stakeholders.
Mandatory Skills
- Strong hands-on experience in GCP.
- Expertise in BigQuery and advanced SQL.
- Strong Python programming and scripting skills.
- Experience in ETL/ELT development.
- Experience building and maintaining data pipelines.
- Knowledge of data warehousing concepts.
- Experience with performance tuning and query optimization.
Good-to-Have Skills
- Google Cloud Dataflow.
- Cloud Composer / Apache Airflow.
- Pub/Sub.
- Cloud Storage (GCS).
- Dataproc / PySpark.
- GCP Dataform.
- CI/CD and Git