GCP Python
Description
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using BigQuery, Spark, and Python on GCP.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop complex SQL queries to extract insights from massive datasets stored in BigQuery.
- Troubleshoot issues related to pipeline failures or performance problems.
Job Requirements :
- 8-14 years of experience in software development with a focus on big data processing.
- Strong proficiency in Python programming language and its ecosystem (e.g., Pandas, NumPy).
- Experience working with Google Cloud Platform services such as BigQuery, Dataflow, Pub/Sub etc.