Senior Databricks Data Engineer
Summary
Senior Databricks Data Engineer at TCS in Belgium: designs, builds, and optimizes scalable ETL/ELT data pipelines on the Databricks Lakehouse using PySpark, Spark SQL, Python, Lakeflow Jobs, and Unity Catalog. Requires 10+ years in the data domain, 4+ years with Databricks, and fluency in English plus Dutch or French.
We are looking for an experienced Senior Databricks Data Engineer to join our team in Belgium. The ideal candidate will have strong hands-on expertise in Databricks, PySpark, Python, Spark SQL, Lakeflow Jobs, and Unity Catalog, with extensive experience building scalable and reliable data solutions on the Databricks Lakehouse platform.
- Design, develop, and optimize scalable data pipelines using Databricks, Python, PySpark, and Spark SQL
- Orchestrate and schedule workflows using Lakeflow Jobs, notebooks, and Python wheel packages
- Work with Unity Catalog, managed tables, and streaming jobs
- Develop robust ETL/ELT pipelines for data ingestion, transformation, and loading
- Optimize Databricks workloads for performance, scalability, and cost efficiency
- Ensure strong data quality, integrity, reliability, and availability
- Troubleshoot data-related issues and continuously improve data engineering solutions
10+ years of experience in the data domain, particularly Data Warehousing and ETL
4+ years of hands-on Databricks experience
Strong expertise in PySpark, Spark SQL, and Python
Solid understanding of Databricks architecture, Lakeflow Jobs, Unity Catalog, and data modelling
Hands-on experience with Git
Strong knowledge of Data Lakes, Data Warehousing, and Lakehouse architecture
Databricks Certified Data Engineer Associate or Professional certification is an advantage
Excellent communication and stakeholder management skills
Fluent in English plus Dutch or French, or both
If you are an experienced Data Engineer looking for an opportunity in Belgium and have strong Databricks expertise, we’d be happy to hear from you.
Please refer this link to see how we collect, store and use the private data of our candidates: https://ibegin.tcsapps.com/candidate/next/en-BE/policies/privacy-notice