GCP Data Engineer

Job Description :

To design, build, and migrate data pipelines and data warehouse workloads to Google Cloud Platform (GCP) while ensuring data quality, performance, and scalable architecture.

Key Responsibilities :

- Design, develop, and maintain data pipelines on Google Cloud Platform (GCP).

- Migrate ETL pipelines from Teradata Enterprise Data Warehouse (EDW) to GCP.

- Develop and optimize complex SQL queries based on business requirements for data warehousing solutions.

- Build and manage pipelines using Dataform and Cloud Composer.

- Work with BigQuery, Cloud Run, and Stackdriver for data processing and monitoring.

- Collaborate with stakeholders to identify and resolve data quality issues and perform root cause analysis.

- Implement and manage CI/CD pipelines using tools such as Jenkins or Cloud Build.

- Participate in Agile development practices, including sprint planning, stand-ups, and retrospectives.

- Ensure high performance, scalability, and reliability of data solutions.

Tech Stack :

- Primary : Google Cloud Platform (GCP), BigQuery, Dataform, Cloud Composer, Cloud Run, SQL.

- Secondary : GitHub, CI/CD, Jenkins/Cloud Build, ITSM, JIRA, JSON.

Desired Experience :

- 4 - 6 years of experience in Data Engineering or Data Warehouse implementations.

- Hands-on experience in building data pipelines using Dataform.

- Strong understanding of data warehouse concepts and architecture.

- Experience with CI/CD pipelines and DevOps practices.

Educational Qualifications :

- Bachelor's or Master's degree in Engineering, Computer Science, Information Technology, or related technical field.

Certifications (Preferred) :

- Google Cloud Professional Data Engineer Certification.