Data Engineering Manager
Summary
Leads a data & analytics team in Amsterdam building ETL pipelines, data platforms, and analytics products (dashboards, APIs, data lakes) for SHV group companies. Core stack is Python/PySpark, Azure (Data Factory, Databricks, Synapse), SQL, and CI/CD workflows.
Adaptfy is growing! We are looking for a Data Engineering Manager for a full-time position to join our Data & Analytics team in Amsterdam.
Who we are
Adaptfy is a turnkey data & analytics solution for the SHV family of companies. We support multiple SHV Groups with advanced Data & Analytics in all areas, elevating their operations in diverse industries across international markets and throughout entire valuechains.
Adaptfy is a joint venture formed by SHV and Metyis. Metyis embodies visionary thinking in the digital world, while SHV is a globally established family of companies built on the values of integrity, trust, curiosity, passion, and inclusivity.
At Adaptfy, we play a pivotal role in bringing SHV’s digital vision to life. From optimising supply chains across Europe to enhancing operational efficiency in South America, we connect the dots for SHV, shaping a data-driven future for the entire family of companies.
What we offer
- Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change
- Become the go-to person for end-to-end data handling, management, and analytics processes.
- Lead your team in creating the pipeline for Data management, data visualization, and analytics products, including automated services, and APIs.
- Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.
- Become part of a fast-growing international and diverse team
What you will do
- Lead, influence & implement the technical roadmap of our clients, in light of overall technology and architecture roadmaps.
- Be responsible for the Architecture, making sure that technical and non-technical components work together in the product to deliver the customer needs.
- Lead and Develop the digital development and operations using Python, Spark, RESTful API, and Microsoft Azure Cloud, ideally with some Data Insights experience.
- Steer the technical excellence of the application and consistency with relevant digital frameworks, best practices, and standards.
- Coach and enable other product team members to deliver best-in-class products.
- Deliver data platforms, data insights and with the collaboration of the data science team – data products, such as recommendation systems, data lakes/hubs, data insights and dashboards.
- Lead project activities and will be responsible for the evaluation of business needs and objectives in collaboration with the project team and other stakeholders.
What you will bring
- 5-7 years of experience in a similar role with experience in developing and deploying ETL solutions on Azure.
- Solid knowledge of data warehousing principles, concepts, and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF).
- Good understanding of common platforms and practices regarding digital development; Cloud-based setups, Advanced Analytics and computing environments, and GitHub (or similar) and CI/CD workflows.
- Experience in setting up automated testing frameworks including unit tests, integration tests.
- Understanding of modern cloud-based architecture (Lambda & Kappa architectures).
- Advanced SQL, data transformation, and data profiling skills.
- Experience in building production ETL/ELT pipelines at scale.
- Data governance experience.
- 3-5 years of hands‑on experience with Azure: Data Factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming.
- Experience with Airflow, Kubernetes, Great expectations is a plus.
- Programming languages: Python (PySpark), scripting languages like Bash.
- Basic knowledge of PowerBI is a plus.
- Customer‑centric, passionate about delivering great digital products and services.
- Demonstrating true engineering craftsmanship mindset.
- Passionate about continuous improvement and working collaboratively.
- Strong problem‑solving skills coupled with the ability to convey designs and ideas to a wider audience.
- People Management experience (2 or 3‑member team).
- Experience in service consulting and stakeholder management.
- Comfortable with ambiguity, highly autonomous.
- A Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research. Statistics, Business or other related technical disciplines (Master's Degree is a plus).
Skills
- Airflow
- Analytics
- API
- Azure
- Azure Data Factory
- Azure Functions
- Bash
- CI/CD
- Cloud
- Data Analytics
- Data Engineering
- Data Governance
- Data Lake
- Data Science
- Data Vault
- Data Visualization
- Data Warehousing
- Databricks
- ELT
- ETL
- GitHub
- Kubernetes
- Lambda
- Power BI
- PySpark
- Python
- Recommendation Systems
- REST
- Spark
- SQL
- Stakeholder Management
- Statistics
- Test Automation
- Vault