Azure Databricks Data Engineer
Summary
Senior Data Engineer builds scalable Azure Databricks pipelines with Python, Spark, dbt, and Azure Data Factory to deliver clean, governed data for analytics and reporting.
Location: Amsterdam, Netherlands
Job Summary
We are looking for an experienced Senior Azure Databricks Data Engineer to join our data engineering team in Amsterdam. The ideal candidate will have strong expertise in building scalable cloud-based data platforms using Azure Databricks, dbt, Azure Data Factory, Spark, and Python. The role involves designing and developing modern data pipelines, implementing data models, ensuring data quality, and supporting enterprise data governance initiatives.
Candidates should have hands‑on experience working in industrialized data environments with strong focus on automation, governance, and analytics.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Databricks, Python, Spark, and SQL.
- Build and maintain reusable data models using dbt (Data Build Tool).
- Develop and orchestrate data workflows using Azure Data Factory (ADF).
- Process large-scale structured and unstructured datasets efficiently.
- Optimize Databricks notebooks, Spark jobs, and SQL queries for performance and cost efficiency.
- Collaborate with business stakeholders, architects, and data analysts to deliver high-quality data solutions.
- Implement and maintain robust Data Quality, Master Data Management (MDM), and Data Governance practices.
- Develop datasets to support reporting and analytics requirements.
- Work closely with reporting teams using Power BI, including DAX-based data models where required.
- Integrate data from multiple enterprise systems while ensuring consistency, security, and reliability.
- Participate in code reviews, troubleshooting, and production support activities.
Mandatory Skills
- Python
- SQL
- dbt (Data Build Tool)
- Power BI (including DAX)
- Data Modeling
- ETL/ELT Development
- Data Quality
- Master Data Management (MDM)
- Data Governance
Preferred Skills
- Microsoft Power BI
- SSIS
- SSRS
- Experience working in enterprise Azure Data Platform environments
- Exposure to modern Data Governance frameworks
- Performance tuning and optimization of Spark workloads