Data Engineer – Lakehouse & Data Platform Job ID: JP055174
Summary
Data Engineer building and maintaining an on-premise Lakehouse data platform using Python, SQL, Delta Lake, and dbt-core in a regulated, hybrid environment in Brussels.
Data Engineer – Lakehouse & Data Platform
We are looking for an experienced Data Engineer to help build and maintain a secure, on-premise data platform in a highly regulated environment. You will work in a multidisciplinary team alongside Data and Solution Architects and a BI Developer.
Key Responsibilities
- Design and develop data ingestion pipelines from files, APIs, and relational databases.
- Implement incremental and streaming data pipelines with strong reliability and traceability.
- Develop Bronze, Silver, and Gold data layers using a Medallion/Lakehouse architecture.
- Manage Delta Lake tables, including ACID transactions, time travel, and data optimization.
- Build and maintain data orchestration workflows and monitoring.
- Implement data lineage, metadata management, and governance practices.
- Develop data endpoints and support BI dashboards and reporting solutions.
Requirements
- Strong Python and SQL skills.
- Proven experience with dbt-core and Delta Lake.
- Knowledge of DuckDB, MSSQL/PostgreSQL, and advanced SQL/CDC.
- Experience with Dagster, Airflow, or equivalent orchestration tools.
- Comfortable working with Linux/OpenShift and PowerShell.
- Familiarity with DataHub, OpenMetadata, or similar governance platforms.
- Experience with BI development; Power BI is a plus.
- Knowledge of Kafka/Debezium, Spark, and Lakehouse architectures is an advantage.
- Strong analytical, documentation, communication, and problem-solving skills.
- Belgian nationality is mandatory due to the nature of the assignment.
Location: Brussels, Belgium
Work Arrangement: Hybrid