Data Engineer (Lakehouse)
Summary
Senior data engineer to own and evolve a lakehouse data platform (S3 + Snowflake/Databricks, Iceberg/Delta/Hudi, Kafka/Debezium CDC) handling financial data for 12M+ users. Hybrid role based in Kraków with 2 office days per week.
The company is looking for a Senior Data Lakehouse Engineer to own the architecture and evolution of the data platform behind millions of financial events across 12M+ active users.
You’ll be responsible for how data is ingested, stored, retained, governed, and reconciled across S3 and Snowflake/Databricks, ensuring analytics, finance, and regulatory teams work with accurate and consistent data.
Responsibilities
- Own and evolve the lakehouse architecture, including bronze/silver/gold layers.
- Define data layout, partitioning, compaction, file sizing, and query optimization at TB+ scale.
- Design reliable CDC and streaming ingestion using Kafka and Debezium.
- Manage schema evolution and handle late, duplicate, and out-of-order events.
- Own retention, archival, immutability/WORM, and regulatory data requirements.
- Ensure data correctness through reconciliation, freshness SLAs, and drift detection.
- Define governance standards including lineage, access control, PII masking, encryption, and audit trails.
- Monitor ingestion health, platform performance, and cloud storage/compute costs.
Requirements
- 5+ years of experience in data engineering.
- Strong experience designing and owning lakehouse architectures.
- Hands‑on experience with Apache Iceberg, Delta Lake, or Hudi.
- Strong knowledge of S3, Snowflake, Databricks, Trino, or Athena.
- Experience optimizing large‑scale data platforms through partitioning, compaction, and storage design.
- Experience with CDC, Kafka, streaming pipelines, and schema evolution.
- Understanding of immutability/WORM retention, governance, and regulatory data requirements.
- Experience with financial, wallet, ledger, iGaming, fintech, or other audit‑heavy data is a strong advantage.
Please note: This is a hybrid role based in Kraków, requiring 2 days per week in the office. Fully remote candidates cannot be considered.