Data Engineer – Azure & Databricks
Responsibilities
- Analyze, implement, and maintain ETL processes using Azure Data Factory and PySpark in Databricks.
- Design and develop high-performance data solutions based on specific functional requirements.
- Prepare and execute comprehensive testing activities to ensure the reliability of data pipelines.
- Perform bug fixing and optimization of pipelines during daily production runs.
- Gather and translate business requirements into detailed functional and technical specifications.
- Manage database modeling tasks using specialized tools such as Erwin or Visio.
Requirements
- 3+ years of experience with Azure cloud data platforms including Data Lake Gen2 and Synapse.
- 3+ years of experience with Databricks and Python programming for data engineering.
- 3+ years of experience in Azure Data Factory and Data Flow.
- 3+ years of experience in DevOps practices, including Infrastructure as Code and CI/CD.
- 3+ years of experience in Power BI and semantic data modeling.
- You bring knowledge of data management principles such as metadata management, lineage, and data quality.
- You possess experience in database modeling using Erwin or Visio.
- You have the ability to handle analytics use cases and translate complex business requirements.
- You're proactive, solution-oriented, and able to work both independently and in a collaborative team environment.
- You are fluent in Dutch or French with basic knowledge of the other, and have a good command of English.
Nice to Haves
- Experience within the insurance or financial domain.
- Experience on projects involving different technology stacks and integration aspects.
- Professional and client-friendly approach.