GCP Data Engineer
Description
Role : GCP Data Engineer
Experience : 14+ years
Location : PAN India
Responsibilities and Expectations :
Build scalable data architectures on Google Cloud, including batch and streaming data pipelines.
Work with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Cloud Composer, and cloud databases.
Build and maintain ELT/ETL pipelines and ingest data from various sources.
Administer BigQuery datasets, tables, and views, and optimize query performance and cost using partitioning and clustering.
Implement data governance and security using IAM, row- and column-level security, Sensitive Data Protection, CMEK, and GDPR-aligned controls.
Build data-validation frameworks, maintain data integrity, and resolve data-consistency issues.
Build semantic layers and support integration with reporting tools.
Support migration from on-premises platforms, Hadoop, RDBMS, or other clouds into GCP.
Design landing, raw, and processed data zones, lifecycle policies, and appropriate storage structures.
Implement logging, alerting, and monitoring, and support incident analysis and troubleshooting.