Freelance Data Engineer
Summary
Freelance data engineer on a small platform team at a large European logistics operator near Rotterdam, building batch and streaming pipelines (Databricks, PySpark, Delta Lake) for shipment tracking and reporting. Hybrid role, 1-2 days onsite, 32-40 hours per week.
Rotterdam area | Hybrid, 1-2 days onsite, 32-40 hours
Leading European logistics and supply chain group
A large logistics operator is modernising its data platform to give real time visibility across warehousing, transport and fleet operations. You’ll join a small platform team building the pipelines that feed shipment tracking, capacity planning and customer reporting.
What you’ll do
- Build and maintain batch and streaming pipelines in Databricks using PySpark and Delta Lake
- Ingest shipment and telematics events from Kafka and Azure Event Hubs into a medallion architecture
- Integrate data from WMS and TMS platforms (Blue Yonder, Manhattan) plus EDI messages from carriers
- Model curated layers with dbt for reporting in Power BI
- Orchestrate workloads with Azure Data Factory and Databricks Workflows
- Manage infrastructure with Terraform and CI/CD in Azure DevOps
- Apply governance and access control through Unity Catalog
What you’ll need
- Strong Python, PySpark and SQL
- Production experience with Databricks and Delta Lake on Azure
- Streaming experience with Kafka or Event Hubs
- dbt in a production setting
- Terraform and Git based CI/CD
- Fluent English | Dutch a plus, not essential
Nice to have: logistics, supply chain or transport data experience (WMS, TMS, EDI, telematics)