Senior Data Engineer
Summary
A GCP Data Engineer in Bangalore who builds and supports enterprise-scale data pipelines and databases on Google Cloud. Day to day involves Airflow, Spark, Dataproc, Dataflow, MySQL/PostgreSQL administration and tuning, BigQuery/Cloud SQL/Spanner, plus containerization (Docker, Kubernetes, Helm) and automation with Python, Shell, and Terraform.
Job Description
Position: GCP Data Engineer
Location: Bangalore
Key Requirements:
- Strong hands-on experience in GCP Data Engineering, including Airflow, Spark, Composer, Dataproc, and Dataflow.
- Strong expertise in MySQL and PostgreSQL, including database administration, schema design, performance tuning, and query optimization.
- Good hands-on experience with GCP databases such as Cloud SQL, Spanner, and BigQuery.
- Strong understanding of OLTP and OLAP architectures.
- Hands-on experience with Docker, Kubernetes, and Helm.
- Strong scripting and automation skills using Python, Shell, and Terraform.
- Good knowledge of GCP Networking and IAM, including roles, permissions, service accounts, and Private Service Connect.
- Experience supporting enterprise-scale database solutions on GCP with strong troubleshooting and problem-solving skills.
.