GCP Data Engineer
Posted 7
views
Description
Role & responsibilities
- Design and implement scalable ETL/ELT pipelines and data warehouse solutions on GCP.
- Develop large-scale batch and streaming data pipelines using Spark, Dataproc, Dataflow, and Pub/Sub.
- Optimize BigQuery data models, SQL queries, and overall warehouse performance.
- Automate workflows using Cloud Composer (Airflow).
- Design solutions leveraging Cloud Storage, Cloud SQL, and Spanner.
- Implement data security, monitoring, logging, and governance best practices.
- Collaborate with Data Science teams to support Vertex AI and GenAI initiatives.
Preferred candidate profile
- 3-6 years of experience in Data Engineering.
- Strong programming skills in Scala.
- Hands-on experience with and performance tuning.
- Expertise in GCP services: BigQuery, Dataproc, Dataflow, Pub/Sub, Cloud Composer.
- Advanced SQL skills including CTEs, Window Functions, and Query Optimization.
- Experience building enterprise-scale ETL/ELT pipelines and Data Warehousing solutions.