Senior Data Engineer
Summary
Designs and maintains scalable data pipelines and BI solutions using Azure Synapse, Databricks, and PySpark to turn raw data into actionable insights for DSV’s global operations.
Responsibilities
- Working with all DSV business divisions as well as group functions to simplify information gathering and turning data into insight
- Design and implement solutions that will support the development of our Operational Data Warehouse (ODW) in alignment with IT and BI architecture principles, guidelines, and standards
- Develop and maintain scalable data pipelines for ingesting, processing and transforming large volumes of data from various sources
- Analyse requirements together with our different department teams and create effort estimations and implementation planning
- Document and provide technical specifications for the implementations
- Refine and promote our agile delivery framework to help ensure high quality and flexible deliverables on the data & BI platform
- Support different department teams in a collaborative work environment
- Actively transfer knowledge to other team members as well as the Operations & Support team
Requirements
- Bachelor’s or master’s degree in computer sciences, Data Science, Information Technology or a related field
- Min 4 years of experiences in BI/Data Engineering project
- Very good understanding and experience in developing efficient, performant and valuable BI solutions with global scale
- Good knowledge of Microsoft’s BI stack, namely Azure Datalake, Azure SQL Database / Azure Synapse, Azure Data Factory, Synapse integration, DevOps, etc.
- Good knowledge in Databricks and PySpark/Scala/Spark SQL
- Ability to monitor, troubleshoot, and optimize data pipelines for performance and reliability
- Very good knowledge in profiling and tuning queries for efficiency
- Good knowledge of Agile methodology and CI/CD practices
- Experience with task management tools (JIRA, Confluence)
- Expert knowledge of data governance principles to ensure data quality, lineage, and compliance
- Knowledge of data modelling concepts
- Knowledge of Power BI (Interest in advancing expertise in Power BI is highly valued)
- Knowledge in Tabular Models development/maintenance
- Knowledge in PowerShell Scripting
- Experience with AI models and development
- Proficient Level of English (spoken and written)
Core Competencies: Demonstrates expertise in developing and maintaining scalable data pipelines, implementing BI solutions, and ensuring data quality and compliance. Proficient in Microsoft’s BI stack and agile methodologies, with strong collaboration and knowledge transfer skills.