Freelance Azure Data Engineer - Freelance
Summary
Freelance/contract Azure Data Engineer in London who designs, builds, and maintains large-scale data pipelines and data infrastructure within the Microsoft Azure ecosystem (Data Factory, Databricks, PySpark, ADLS) for Collective.work's AI-powered recruitment platform, making high-quality data accessible to AI agents and product features.
Job description
Context
Collective.work is building the next generation of AI-powered recruitment. The company supports over 20,000 recruiters and headhunters across France, Belgium, Spain, and EMEA, and is expanding its product and distribution in the UK. Their platform combines a suite of AI agents — from sourcing and outreach to job posting and ATS integrations — with a database of 800M+ professional profiles and a network of 1M+ active candidates.
Missions
- Design, build, and maintain scalable data pipelines for large-scale data ingestion, transformation, and enrichment.
- Develop and optimise data infrastructure within the Microsoft Azure ecosystem.
- Improve data quality, reliability, and processing performance.
- Make high-quality data accessible to AI agents and product features.
- Collaborate with engineering and product teams to deliver robust, production-ready solutions.
Tools & Environment
- Microsoft Azure data services
- Azure Data Factory
- Databricks
- PySpark
- Azure Data Lake Storage
- SQL
- Python
Working Conditions
- Location: London, UK
- Type: Freelance / Contract
- Start date: ASAP
- Duration and day rate: To be agreed
Requirements
- Strong experience in data engineering and production-grade ETL/ELT pipelines
- Hands-on expertise with Microsoft Azure data services
- Excellent SQL skills and experience with Python
- Experience processing large datasets and optimising data workflows
- Autonomy, a problem-solving mindset, and the ability to deliver in a fast-moving environment
- Experience with Azure Data Factory, Databricks, PySpark, and Azure Data Lake Storage is a plus