Freelance Data Engineer
Summary
Freelance data engineer on a small platform team at a large European logistics operator, building batch/streaming pipelines in Databricks (PySpark, Delta Lake), ingesting Kafka/Event Hubs events, modeling with dbt for Power BI, and managing infra with Terraform and Azure DevOps. Hybrid, Rotterdam area, 32-40 hrs/week.
Rotterdam area | Hybrid, 1-2 days onsite, 32-40 hours
Vaardigheden, ervaring, kwalificaties: als u de juiste match bent voor deze functie, zorg er dan voor dat u vandaag nog solliciteert.
Leading European logistics and supply chain group
A large logistics operator is modernising its data platform to give real time visibility across warehousing, transport and fleet operations. You’ll join a small platform team building the pipelines that feed shipment tracking, capacity planning and customer reporting.
What you’ll do
- Build and maintain batch and streaming pipelines in Databricks using PySpark and Delta Lake
- Ingest shipment and telematics events from Kafka and Azure Event Hubs into a medallion architecture
- Integrate data from WMS and TMS platforms (Blue Yonder, Manhattan) plus EDI messages from carriers
- Model curated layers with dbt for reporting in Power BI
- Orchestrate workloads with Azure Data Factory and Databricks Workflows
- Manage infrastructure with Terraform and CI/CD in Azure DevOps
- Apply governance and access control through Unity Catalog
What you’ll need
- Strong Python, PySpark and SQL
- Production xgiwjmb experience with Databricks and Delta Lake on Azure
- Streaming experience with Kafka or Event Hubs
- dbt in a production setting
- Terraform and Git based CI/CD
- Fluent English | Dutch a plus, not essential
Nice to have: logistics, supply chain or transport data experience (WMS, TMS, EDI, telematics)