Data Engineer
Summary
A data engineer role in Bangalore focused on GCP database products (Cloud SQL, Spanner, BigQuery) and data pipelines built with Airflow, Spark, and GCP services like Composer, Dataproc, and Dataflow. Day-to-day work includes schema design, performance tuning, infrastructure automation with Python/Terraform, and running database workloads on Docker/Kubernetes.
About the Company
Resource to have good skills in RDBMS (MySQL, PostgreSQL) and also GCP databases along with Data Engineering exposure.
About the Role
Strong data engineering hands-on experience with Airflow, Spark and GCP services like Composer, Dataproc, Dataflow, etc.
Responsibilities
- Strong technical hands-on experience and knowledge of GCP database products – Cloud SQL, Spanner, BigQuery, etc., their advantages, features offered, limitations and ideas to overcome those limitations, maintaining service infrastructure and debugging issues.
- Deep expertise in MySQL and PostgreSQL including schema design, performance tuning, query optimization and DB administration.
- Solid understanding of OLTP and OLAP architectures and practical experience working with both types of systems.
- Deep expertise working with Docker, Kubernetes and Helm (OpenShift/GKE/AKS/EKS).
- Strong scripting and automation skills in Python, Shell, and Terraform for Infrastructure management.
- Knowledge on Java - Spring, Hibernate, JPA, connection pooling etc. is a plus to recommend solutions to applications for debugging connectivity and performance issues from their end.
- Proficiency in GCP networking, design, and configuration.
- Knowledge on GCP Private Service Connect concepts.
- Experience with GCP IAM – user and service account access, permissions, roles, policies, best practices.
- Strong problem-solving and analytical ability with a keen focus on delivering tangible outputs.
- Willingness and genuine interest to work on new Database product POCs and bringing them to Production.
- Prior experience supporting enterprise-scale database solutions on GCP.
Qualifications
Education details
Required Skills
Strong data engineering hands-on experience with Airflow, Spark and GCP services.
Preferred Skills
Knowledge on Java - Spring, Hibernate, JPA, connection pooling etc.
Pay range and compensation package
Pay range or salary or compensation
Equal Opportunity Statement
Include a statement on commitment to diversity and inclusivity.