Expert Data Consultant with GCP
Summary
Designs and builds scalable data pipelines and cloud solutions on Google Cloud Platform using Python, Apache Airflow, BigQuery, and Spark to support analytics and decision-making.
Contract type: B2B contract
Salary range: 155-208 PLN/h
What will you do?
You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing and developing robust data pipelines, data models, and cloud-based data solutions that support business-critical analytics and decision-making. As an Expert Data Engineer, you will contribute deep technical expertise, solve complex data challenges, and help ensure the platform is reliable, scalable, and maintainable.
Your tasks
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks such as DBT or Spark
- Work with BigQuery and Cloud SQL to store, process, and transform large datasets
- Design and implement efficient data models and integration solutions
- Ensure data quality, integrity, reliability, and performance across the platform
- Analyze and resolve complex data engineering challenges
- Collaborate with business stakeholders to translate requirements into scalable data solutions
- Maintain technical documentation and contribute to platform improvements
- Support deployment, monitoring, and optimization of data solutions in GCP environments
- Participate in code reviews and promote engineering best practices
Requirements
- 5+ years of experience in Data Engineering or a related field
- Expert-level Python programming skills
- Strong hands-on experience with Google Cloud Platform, including BigQuery, Cloud Storage, Compute Engine, or GKE
- Extensive experience with ETL/ELT and data integration pipelines
- Strong expertise in Apache Airflow for workflow orchestration
- Hands-on experience with Spark
- Strong understanding of data architecture and data modeling concepts
- Experience working with large and complex datasets
- Strong knowledge of relational databases
- Experience with NoSQL databases
- Good understanding of data quality and data governance principles
- Strong analytical and problem-solving skills
- Ability to work independently on complex technical challenges
- Openness to work hybrid from our client's office (Kraków) 4 days a month
Nice to have skills
- Apache Beam