Senior Data Engineer
Summary
Senior Data Engineer joining a Sustainability Data & AI team to build a sustainability data foundation on Databricks: designing PySpark/Delta Lake pipelines, data models, quality controls, and CI/CD for sustainability reporting and regulatory compliance. Remote, full-time, 12-month contract with extension option and occasional trips to Denmark.
We are looking for a Senior Data Engineer to join our Sustainability Data & AI team and help build and operate a modern Sustainability Data Foundation based on Databricks.
You will develop scalable data products and pipelines supporting sustainability reporting, regulatory compliance and analytics, taking ownership from design through production.
Workload: Full-time
Work model: Remote
Business Travels: YES (business trips to Denmark from time to time)
Duration: 12 months + option for extension
Start Date: 01/27
Your responsibilities:
Design and develop data pipelines and data products using Databricks, Delta Lake and PySpark.
Build data models and transformation frameworks for large and complex datasets.
Develop data quality controls, validation and reconciliation processes.
Optimize pipelines for performance, scalability and cost.
Implement CI/CD, automated testing and deployment processes.
Support data governance, lineage, security and access management.
Work closely with Sustainability, Business, Product and Reporting teams.
Troubleshoot issues, perform root-cause analysis and ensure reliable production delivery.
Develop Databricks-based tools to simplify data access and reporting.
Requirements:
5+ years of experience in data engineering and data platforms.
Strong production experience with Databricks.
Expert knowledge of PySpark, SQL, data modelling and data pipeline design.
Experience with CI/CD, Git, automated testing and deployment.
Knowledge of data quality, governance, lineage and auditing.
Strong troubleshooting and root-cause analysis skills.
Ability to take ownership and deliver pragmatic, production-ready solutions.
Nice to have:
Experience with ESG / sustainability or regulatory reporting.
Knowledge of ERP, procurement, finance or supplier data.
Experience building Databricks applications, dashboards or user-facing tools.