Principal AI Data Engineer (GenAI/Agentic AI) - Contract Opportunity

Principal AI Data Engineer (GenAI/Agentic AI) - Contract Opportunity

• Principal AI Data Engineer
• Hybrid Working
• Initial 6-Month Contract (Inside IR35)
• Long-Term Programme with expected extensions over a multi-year transformation initiative

We are seeking an experienced Principal AI Data Engineer to join a large-scale AI and data transformation programme. This is an exciting opportunity to help shape and deliver cutting-edge GenAI, Agentic AI and Data Engineering solutions, taking concepts from prototype through to enterprise-scale production deployment.

You’ll play a key role in designing, building and scaling AI-powered solutions that deliver real business value, while collaborating with both technical and non-technical stakeholders across a complex global environment.

The Role

As a Principal AI Data Engineer, you will:

• Develop and evaluate GenAI, Agentic AI and AI-powered prototypes using modern AI platforms and frameworks.
• Design, build and optimise Retrieval-Augmented Generation (RAG) solutions, including embedding strategies, prompt engineering and evaluation frameworks.
• Build and deploy AI agents using technologies such as LangChain, LangGraph, AutoGen and similar frameworks.
• Deliver production-grade AI applications using Azure OpenAI, Azure AI Foundry, Databricks Mosaic AI, MLflow, Agent Bricks and Docker.
• Create scalable and reusable solutions using Python and modern software engineering practices.
• Build and manage AI workflows on Databricks, leveraging Delta Lake, DLT, Unity Catalog and MLflow.
• Develop robust evaluation, benchmarking and testing frameworks for GenAI systems.
• Work with large-scale structured and unstructured datasets, ensuring reproducibility and high engineering standards.
• Contribute to architecture, technical strategy and long-term platform design.
• Partner closely with stakeholders, translating complex AI concepts into clear business outcomes.
• Lead technical direction, influence delivery roadmaps and help shape future AI capabilities.

Key Skills & Experience

• 8-12+ years’ experience delivering Data Science, AI or Advanced Analytics projects

Strong experience with:

• Databricks (DLT, Delta Lake, Unity Catalog)
• Python, SQL and/or Scala
• Spark Structured Streaming and Auto Loader
• Data modelling, ETL/ELT and data architecture
• ADF and Qlik Replicate
• CI/CD, GitHub workflows and DevOps best practices

Deep understanding of:

• Large Language Models including GPT, Llama, Claude and Mistral
• GenAI architecture and implementation
• RAG design patterns and evaluation techniques
• Agentic AI frameworks and orchestration

Hands-on experience with:

• Databricks Mosaic AI
• MLflow
• Agent Bricks

Proven ability to:

• Take AI solutions from proof-of-concept to production
• Operate in Agile environments
• Influence senior stakeholders
• Lead technical workstreams and help define future delivery backlogs

What's on Offer?

• Industry-leading AI and GenAI programme
• Opportunity to work on production-scale Agentic AI initiatives
• Long-term contract potential within a multi-year programme
• High-profile role with significant technical influence