DevOps HSBCJP00057554

DevOps Cloud Engineer (GCP / Data Platform / Airflow)
📍 Hybrid (2 days per week from Cracow)

We are looking for an experienced DevOps Cloud Engineer to join a team responsible for building and evolving a scalable, multi-tenant data integration platform on Google Cloud Platform (GCP).

The platform leverages Apache Airflow to orchestrate ETL/ELT pipelines, enabling reliable data movement from source systems through the platform into downstream vendor systems. A key focus of the role is improving automation, deployment pipelines, and implementing end-to-end data lineage for full visibility of data flows.

Key responsibilities

• Design, develop, test, and maintain ETL/ELT pipelines orchestrated via Apache Airflow (DAGs)
• Build and enhance platform capabilities supporting multi-tenant data integration use cases
• Design and implement scalable deployment pipelines for Apache Airflow environments
• Develop and optimise SQL-based transformations and integrations, including work with Google BigQuery
• Implement data lineage capabilities to enable end-to-end traceability of data flows
• Automate operational and engineering processes to improve reliability, scalability, and efficiency
• Build and maintain test automation frameworks (regression and performance testing)
• Work in an Agile delivery environment, contributing to iterative development and continuous improvement
• Troubleshoot complex issues across infrastructure, pipelines, and data flows; drive root cause analysis and preventive solutions
• Collaborate with engineers, product stakeholders, and partner teams to ensure alignment and delivery

Required skills & experience

• 10+ years of experience in software engineering, DevOps, and/or cloud engineering roles
• Strong hands-on experience with Google Cloud Platform (GCP), including BigQuery and related services
• Proven experience building and maintaining ETL/ELT pipelines using Apache Airflow (DAG design, scheduling, monitoring, scaling)
• Advanced SQL skills for data transformation, validation, and performance optimisation
• Experience designing multi-tenant architectures and scalable, resilient platforms
• Strong background in CI/CD and deployment automation, ideally for data platforms or Airflow environments
• Experience with test automation, including regression and performance testing frameworks
• Solid understanding of data concepts: data quality, metadata, governance, and data lineage
• Familiarity with data visualisation tools for operational or lineage insights
• Strong problem-solving skills with a focus on automation and reliability improvements
• Excellent communication skills and ability to work in cross-functional Agile teams