Senior Data Engineer
Summary
A 3-month Outside IR35 contract (high extension likelihood) for a Senior Data Engineer in London (hybrid), modernizing a high-growth tech company's core data platform. Day-to-day: designing scalable ETL/ELT pipelines and lakehouse architecture across AWS, GCP/Azure using Python, SQL, Spark, dbt and Terraform.
- Initial Duration: 3 Months (High likelihood of extension)
- Location: London (Hybrid / Flexible remote pattern)
- Day Rate: Competitive Market Rate
The Role
Are you a seasoned Senior Data Engineer looking for your next high-impact assignment?
We are partnering with an ambitious, high-growth London tech organization to deliver a critical modernization phase of their core data platform. As an Outside IR35 engagement, this role requires an independent subject matter expert who can step in, evaluate current data architecture, and execute key infrastructure improvements across a dynamic multi-cloud setup.
You will have total technical autonomy to design, optimize, and deliver robust data pipelines that process massive real-time datasets.
Core Responsibilities
- Multi-Cloud Architecture: Optimize and streamline data flow across primary public cloud platforms (AWS & GCP / Azure).
- Pipeline Engineering: Build, maintain, and refine resilient, scalable ETL/ELT pipelines to support high-throughput data processing.
- Data Lakehouse Optimization: Elevate storage architectures, modern data stack tools, and query engines for maximum performance.
- Modern Tooling: Drive technical delivery using Python, SQL, Spark, dbt, and Terraform.
- Best Practices & Governance: Champion robust engineering standards around CI/CD, data quality, and automated monitoring.
- Data Engineering Mastery: Deep background in production-grade data pipeline architecture and orchestration.
- Multi-Cloud Exposure: Hands-on commercial expertise across at least two major cloud platforms (AWS, GCP, or Azure).
- Modern Data Stack: Expertise with Python, PySpark, SQL, and transformation frameworks like dbt.
- Infrastructure as Code: Proficiency with Terraform or CloudFormation to ensure repeatable deployment environments.
- Independent Execution: Ability to take direct ownership of project deliverables, work autonomously, and provide clear technical direction.
Why This Engagement?
- Clear Outside IR35 Status: Fully assessed and structured for independent consultancy delivery.
- High-Impact Architecture: Direct ownership of critical multi-cloud features rather than routine maintenance.
- Project Longevity: A fast-paced 3-month initial scope with a solid roadmap driving long-term extension potential.
- Flexible Working: Modern London-based workspace with a highly flexible hybrid rhythm.
Note on IR35 Compliance: This contract has been scoped strictly as a statement of work (SOW) for deliverable-based execution, providing autonomy over working methods, hours, and location.
What they ask for
Required
- Deep background in production-grade data pipeline architecture and orchestration
- Hands-on commercial expertise across at least two major cloud platforms (AWS, GCP, or Azure)
- Expertise with Python, PySpark, SQL, and transformation frameworks like dbt
- Proficiency with Terraform or CloudFormation for infrastructure as code
- Ability to take direct ownership of deliverables, work autonomously, and provide clear technical direction
- Ability to work as an independent subject matter expert on an Outside IR35 statement-of-work engagement
- Experience optimizing data lakehouse storage architectures, modern data stack tools, and query engines
- Familiarity with CI/CD, data quality, and automated monitoring best practices