Associate Data Engineering L2 (GCP)

Summary

Builds and maintains scalable GCP data pipelines and ETL workflows in Python to process and store large datasets for analytics and insights.

We are looking for a talented Data Engineer to join our dynamic team and help us leverage data to drive business insights and innovation.

Responsibilities:

Design, develop, and maintain scalable data pipelines and ETL processes using GCP services.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Implement data integration solutions to ingest, process, and store large volumes of data from various sources.
Optimize and troubleshoot data workflows to ensure high performance and reliability.
Develop and maintain data models, schemas, and documentation.
Ensure data quality, integrity, and security across all data pipelines.
Monitor and manage cloud resources to ensure cost-effective and efficient data processing.

Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as a Data Engineer or in a similar role.
Proficiency in Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
Strong proficiency in Python for data processing and automation.
Expertise in designing and implementing ETL processes.
Familiarity with SQL and database management systems.
Knowledge of data warehousing concepts and best practices.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.

Preferred Qualifications:

Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
Familiarity with data visualization tools (e.g., Looker, Tableau).
Understanding of machine learning and data science concepts.