Senior Data Engineer
Posted 1
view
Summary
Senior Data Engineer joining IG, a global FTSE 100 fintech, in Kraków on a hybrid basis (3 days/week in office). Day to day: build batch and real-time data pipelines on GCP using BigQuery, Kafka, Airflow and dbt (Medallion architecture), plus data quality, lineage, observability, CI/CD and mentoring junior engineers.
Kraków | Hybrid: 3 days/week in the office
Permanent employment only
Join a global FTSE 100 fintech and help consolidate IG’s data ecosystem onto GCP. You’ll build secure, reliable data solutions powering analytics, compliance and future AI/ML products.
Your impact:
- Build batch and real-time pipelines using BigQuery, Kafka and Airflow
- Develop GCP ingestion capabilities with GCS and Cloud Run
- Create dbt transformations within a Medallion architecture
- Implement data contracts, quality checks, lineage, observability and SLO monitoring
- Improve CI/CD, engineering standards and shared datasets
- Mentor junior engineers and support ML data pipelines
You bring:
- Strong production experience with GCP, Python and SQL
- BigQuery, Cloud Composer/Airflow, GCS and Cloud Run
- Kafka or equivalent streaming technology
- dbt and Bronze/Silver/Gold modelling knowledge
- Experience with data governance, access controls and audit trails
- Confidence working in a regulated financial environment