Data Engineer - Databricks, BI
Summary
Builds and optimizes Databricks/Spark pipelines and Delta Lake models to power BI dashboards and ML workloads for a global brewer’s data ecosystem.
Digital & Technology Team (D&T)
Heineken Global Shared Services Center's Digital & Technology Team is committed to making Heineken the most connected brewery. The team is focused on digitalizing and integrating processes, ensuring best‑in‑class technology, and embedding a data‑driven culture. Members of this dynamic and innovative team have a direct impact on building the future of Heineken.
Technology Specialist – Azure
The Technology Specialist – Azure is responsible for designing, building, and optimizing scalable data solutions that enable advanced analytics, BI reporting, and machine learning initiatives. This role requires strong expertise in Databricks, Delta Lake, and cross‑team collaboration to deliver high‑quality, production‑ready data models for business consumption.
Responsibilities
- Building and maintaining Spark Declarative Pipelines for Bronze/Silver layer ingestion using metadata‑driven configuration and business‑oriented Gold Layers utilizing materialised views and other state‑of‑the‑art data engineering techniques.
- Develop reliable CDC and incremental load patterns (FULL LOAD, INCREMENTAL, APPEND) with proper merge/apply‑changes semantics.
- Implement performance optimisations such as Liquid Clustering for Delta tables supporting BI and ML workloads.
- Design and maintain Unity Catalog data assets with proper access controls and row‑level security.
- Perform in‑depth data analysis, source‑to‑target mapping and validation to ensure correctness and completeness.
- Define and implement automated data quality checks, validation rules and anomaly detection.
BI & ML Data Modeling
- Translate BI (Power BI) and machine learning requirements into well‑structured, scalable data models.
- Ensure datasets are optimised for fast query performance, semantic clarity and downstream analytics consumption.
- Work closely with BI developers to streamline data flows and improve dashboard performance.
- Collaborate with SAP/OTM integration teams, orchestration teams and MLOps teams to ingest, transform and operationalise data from multiple systems.
- Ensure end‑to‑end pipeline reliability, versioning, documentation and monitoring across environments.
- Partner with ML optimisation teams to integrate and operationalise model outputs within the broader data ecosystem.
Qualifications
- Strong expertise in Databricks, PySpark, Delta Lake and SQL.
- Proven experience building complex data pipelines and large‑scale data models.
- Ability to collaborate effectively with cross‑functional teams in a fast‑paced analytics environment.
- Strong analytical mindset with close attention to detail and data quality.
- 5–8+ years of experience in data engineering or a related field.
- Excellent English language skills.
Preferred Qualifications
- Experience with Power BI dataset optimisation and gateway configuration.
- Hands‑on knowledge of PowerApps for workflow automation or data collection scenarios.
- Understanding of the ML model lifecycle and MLOps tools.
Legal & Compliance
HEINEKEN Kraków takes integrity and ethical conduct seriously. If any concerns about a possible violation of legal regulations or the company’s Code of Business Conduct arise, employees are encouraged to report them through the appropriate channels in line with the local HGSS Whistleblowing procedure.