Senior GCP Data Engineer – BigQuery & Data Pipeline Development

Summary

Designs and deploys GCP data models and pipelines in BigQuery for a financial services client, transforming raw data into Data Vault models using SQL, ETL/ELT processes, Cloud Composer, Python, and Terraform in a hybrid Krakow setup.

Unleash the Power of Data – Transform Business Insights with Cutting-Edge Cloud Engineering!

Krakow-based opportunity with hybrid work model.

As a Senior GCP Data Engineer – BigQuery & Data Pipeline Development, you will be working for our client, a leading financial services organization, on a transformative data integration initiative. Your expertise will support the global MSS Operations team, enhancing data processing and analytics capabilities across multiple sources and enabling data-driven decision-making at scale. This role offers a platform for innovation and professional growth in the rapidly evolving cloud data landscape.

Your main responsibilities:

  • Design, build, test, and deploy GCP data models and transformations in BigQuery (including stored procedures, indexes, clusters, partitions, triggers).
  • Create and manage ETL/ELT data pipelines transforming raw or unstructured data into a Data Vault model.
  • Review, interpret, and implement business and technical requirements, ensuring compliance with IT and security standards.
  • Monitor data pipelines for failures or performance issues, implementing solutions for scalability and robustness.
  • Optimize ETL/ELT processes to handle large data volumes efficiently.
  • Integrate data from various sources, maintaining consistency and accuracy.
  • Manage code artifacts and CI/CD pipelines using Git, Jenkins, Terraform, with a focus on GCP cloud applications.
  • Collaborate within an Agile environment, applying DataOps best practices to deliver high-quality solutions.

You’re ideal for this role if you have:

  • At least 3 years of hands-on experience with SQL querying and optimization in BigQuery.
  • Proven expertise in SQL Data Transformation, ETL/ELT pipeline development in GCP DataFusion or similar tools.
  • Strong experience with Data Vault modeling principles.
  • Skilled in Cloud Composer/Airflow, Cloud Run, Pub/Sub, Python, and Terraform.
  • Proficiency with version control (Git) and CI/CD processes, including tools like Jenkins or Ansible.
  • Experience working in a DataOps environment and Agile methodologies.
  • Excellent problem-solving, organizational, and multi-tasking skills.

Nice to have:

  • Experience designing data ingestion pipelines with GCP Data Fusion, CDAP, or comparable tools (handling CSV, JSON, XML, RESTful & SOAP APIs, SFTP).
  • Knowledge of Java development for custom Data Fusion plugins.
  • Familiarity with continuous testing and deployment tools for cloud data solutions.

Language Required for the role:

  • English (Communicative proficiency required)

Eligibility to work in Europe:

  • Only candidates with an existing legal right to work in the European Union will be considered for this role.

#MAKEYourCareerBETTER

Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.