Senior Data Engineer - Leading PE firm - London
My client, a leading Private Equity firm, is seeking an experienced Senior Data Engineer to join their London-based investment team.
This is a high-impact role sitting directly within the Research & Technology function, reporting into the Head of Research & Technology and partnering closely with investment professionals across the business.
You will take ownership of the firm's data platform, helping to build and evolve the infrastructure that underpins investment decision-making. The role combines hands-on engineering, architecture, automation and AI, with significant exposure to senior stakeholders across Research, Investments, Finance and Asset Management.
Working within a collaborative, fast-paced environment, you'll lead technology initiatives from concept through to production while helping shape the firm's long-term data strategy.
Responsibilities
- Own the end-to-end data platform architecture, including data ingestion, storage, modelling and consumption layers
- Design and implement scalable ETL pipelines and modern data infrastructure
- Define and enforce data governance standards, lineage tracking, access controls and data quality frameworks
- Convert existing Excel-based financial and research models into robust, maintainable and tested Python applications
- Build reusable analytical libraries covering real estate metrics and investment KPIs
- Develop and maintain CI/CD pipelines, scheduling infrastructure and monitoring dashboards to improve platform observability
- Drive automation initiatives across Research, Investments, Finance and Asset Management teams
- Design and deploy agent-based and multi-agent AI workflows to enhance research and investment processes
- Lead the delivery of new technology initiatives from requirements gathering through to production deployment
- Partner directly with non-technical stakeholders to translate business requirements into scalable technical solutions
Requirements
- 5+ years' experience as a Data Engineer or in a similar data platform engineering role
- Strong Python and SQL development skills
- Experience designing and building modern data platforms and ETL pipelines
- Strong understanding of data modelling, architecture, governance and data quality best practices
- Experience working with cloud-based data technologies and modern engineering tooling
- Experience building scalable, production-grade data solutions
- Excellent communication skills with the ability to work directly with business stakeholders
- A proactive, ownership-driven mindset with a passion for automation and continuous improvement
My client offers a highly competitive total compensation package, alongside excellent benefits and the opportunity to work within a high-performing investment team where technology plays a central role in driving investment decisions.