Data Engineering Associate
Summary
Data Engineering Associate (3-6 yrs experience) joining Adaptfy - a data & analytics joint venture of SHV and Metyis - in Amsterdam, building ETL/ELT pipelines, data lakes, and streaming data hubs for SHV companies, mainly with Azure (Data Factory, Databricks, Synapse), Python/PySpark, Airflow, Kubernetes, Docker, and advanced SQL.
Adaptfy is growing! We are looking for a Data Engineering Associate with 3 - 6 years of experience for a full-time position to join our Data and Analytics team in Amsterdam.
Data & Analytics
Mid
Who we are
Adaptfy is a turnkey data & analytics solution for the SHV family of companies. We support multiple SHV Groups with advanced Data & Analytics in all areas, elevating their operations in diverse industries across international markets and throughout entire valuechains.
Adaptfy is a joint venture formed by SHV and Metyis. Metyis embodies visionary thinking in the digital world, while SHV is a globally established family of companies built on the values of integrity, trust, curiosity, passion, and inclusivity.
At Adaptfy, we play a pivotal role in bringing SHV’s digital vision to life. From optimising supply chains across Europe to enhancing operational efficiency in South America, we connect the dots for SHV, shaping a data-driven future for the entire family of companies.
What we offer
- Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change.
- Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.
- Become part of a fast-growing international and diverse team.
What you will do
- Engineer complete technical solutions to solve concrete business challenges in the areas of digital marketing, e-commerce, Business Intelligence, and self-service analytics.
- Collect functional and non-functional requirements, consider technical environments, business constraints, and enterprise organizations.
- Support our clients in executing their Big Data strategies by designing and building operational data platforms: ETL pipelines, data anonymization pipelines, data lakes, near real-time streaming data hubs, web services, training and scoring machine learning models.
- Collaborate closely with partners, strategy consultants, and data scientists in a flat and agile organization where personal initiative is highly valued.
- Share data engineering knowledge by giving technical training.
- Guide and mentor team members.
What you will bring
- 3-4 years of experience in data analytics.
- Understanding of data warehousing principles, concepts and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF).
- Advanced SQL, data transformation and data profiling skills.
- Experience of building production ETL/ELT pipelines at scale.
- 1-2 years of hands on experience with Azure: Data factory, Databricks, Synapse (DWH), Azure Functions, App logic and other data analytics services, including streaming.
- Experience with Airflow and Kubernetes.
- Programming languages: Python (PySpark), scripting languages like Bash.
- Knowledge of Git, CI/CD operations and Docker.
- Basic knowledge of PowerBI is a plus.
- True engineering craftsmanship mindset.
- Passionate about continuous improvement and working collaboratively.
- Strong problem-solving skills, coupled with the ability to convey designs and ideas to a wider audience.
- Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research, Statistics, Business or other related technical disciplines (Master's Degree is a plus).