Senior GCP Data Engineer – BigQuery & Data Pipeline Development
Summary
Designs and deploys GCP data models and pipelines in BigQuery for a financial services client, transforming raw data into Data Vault models using SQL, ETL/ELT processes, Cloud Composer, Python, and Terraform in a hybrid Krakow setup.
Unleash the Power of Data – Transform Business Insights with Cutting-Edge Cloud Engineering!
Krakow-based opportunity with hybrid work model.
As a Senior GCP Data Engineer – BigQuery & Data Pipeline Development, you will be working for our client, a leading financial services organization, on a transformative data integration initiative. Your expertise will support the global MSS Operations team, enhancing data processing and analytics capabilities across multiple sources and enabling data-driven decision-making at scale. This role offers a platform for innovation and professional growth in the rapidly evolving cloud data landscape.
Your main responsibilities:
- Design, build, test, and deploy GCP data models and transformations in BigQuery (including stored procedures, indexes, clusters, partitions, triggers).
- Create and manage ETL/ELT data pipelines transforming raw or unstructured data into a Data Vault model.
- Review, interpret, and implement business and technical requirements, ensuring compliance with IT and security standards.
- Monitor data pipelines for failures or performance issues, implementing solutions for scalability and robustness.
- Optimize ETL/ELT processes to handle large data volumes efficiently.
- Integrate data from various sources, maintaining consistency and accuracy.
- Manage code artifacts and CI/CD pipelines using Git, Jenkins, Terraform, with a focus on GCP cloud applications.
- Collaborate within an Agile environment, applying DataOps best practices to deliver high-quality solutions.
You’re ideal for this role if you have:
- At least 3 years of hands-on experience with SQL querying and optimization in BigQuery.
- Proven expertise in SQL Data Transformation, ETL/ELT pipeline development in GCP DataFusion or similar tools.
- Strong experience with Data Vault modeling principles.
- Skilled in Cloud Composer/Airflow, Cloud Run, Pub/Sub, Python, and Terraform.
- Proficiency with version control (Git) and CI/CD processes, including tools like Jenkins or Ansible.
- Experience working in a DataOps environment and Agile methodologies.
- Excellent problem-solving, organizational, and multi-tasking skills.
Nice to have:
- Experience designing data ingestion pipelines with GCP Data Fusion, CDAP, or comparable tools (handling CSV, JSON, XML, RESTful & SOAP APIs, SFTP).
- Knowledge of Java development for custom Data Fusion plugins.
- Familiarity with continuous testing and deployment tools for cloud data solutions.
Language Required for the role:
- English (Communicative proficiency required)
Eligibility to work in Europe:
- Only candidates with an existing legal right to work in the European Union will be considered for this role.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.