Data Engineering Lead
Summary
The Data Engineering Lead will design and implement high-performance data solutions using Databricks, Apache Spark, and AWS cloud infrastructure. This role focuses on building scalable data platforms and optimizing distributed computing workflows within a financial services environment.
Salary: £62,000 - 102,000 per year
Requirements:- Proven in-depth commercial experience in Databricks, including Lakehouse architecture, Spark, Delta Lake, workflows, and performance tuning.
- Proven in-depth commercial experience in Apache Spark and Scala, with high-performance distributed data processing and optimisation.
- Proven in-depth commercial experience in cloud data engineering on AWS, including cloud-native data platforms and distributed computing.
- Proven in-depth commercial experience in data services architecture and engineering, including distributed processing, reprocessing, streaming, and scalable data services.
- Proven in-depth commercial experience in engineering architecture and technical delivery, including solution architecture, engineering governance, CI/CD, and technical leadership.
- Experience in implementing projects.
- Experience in systems analysis and programming of software applications.
- Demonstrated subject matter expertise in applications development.
- Demonstrated knowledge of client core business functions.
- Demonstrated leadership, project management, and development skills.
- Relationship and consensus-building skills.
- Bachelors degree, university degree, or equivalent experience.
- Masters degree preferred.
- Lead the design, engineering, and delivery of next-generation cloud data services supporting data pre-processing, advanced matching engines, AI/GenAI services, and large-scale data platforms.
- Drive transformation of enterprise data capabilities using Databricks, Scala/Spark, and cloud-native architectures.
- Ensure the platform is stable, scalable, resilient, secure, and AI enabled.
- Design, implement, and optimise Databricks/AWS-based data solutions across the GRU tech space.
- Develop application methodologies and standards for program analysis, design, coding, testing, debugging, and implementation.
- Use advanced knowledge of supported main system flows and comprehensive knowledge of multiple areas to achieve technology goals.
- Consult with end users to identify system function specifications and incorporate them into overall system design.
- Allocate work and act as an advisor and coach to developers, analysts, and new team members.
- Influence and negotiate with senior leaders and communicate with external parties.
- Assess risk appropriately in business decisions, considering our reputation and safeguarding our clients and assets.
- Drive compliance with applicable laws, rules, and regulations.
- Adhere to policy, apply sound ethical judgment, and escalate, manage, and report control issues with transparency.
- AI
- AWS
- CI/CD
- Cloud
- Databricks
- Network
- Scala
- Spark
- Support
- LLM
More:
We are Citi, a global technology and financial services organisation with more than 230,000 people worldwide, operating in 180+ countries and processing $5 trillion across our network every day. Our Technology team is helping redefine finance through advanced AI, global-scale systems, and innovation that influences economies and touches millions of people. This role is part of our Enterprise Data organisation in Belfast, Northern Ireland, where we are leading the engineering of cloud-native data services for our strategic platform and driving migration to Databricks. We offer a business casual workplace, a hybrid working model with up to 2 days working from home per week, a competitive base salary, annual performance-related bonus, private medical care and life insurance, employee assistance, pension, paid parental leave, 27 days annual leave plus bank holidays, discounts for employees and their families, and access to learning and development resources.
last updated 35 week of 2026