Databricks Architect

Our Data Architects provide expertise, guidance, and strategic advice to clients, helping them develop robust, scalable, and efficient data solutions using Databricks. They play a critical role in designing and implementing modern lakehouse architectures to support advanced analytics, AI, and business intelligence use cases. Engaging with clients early in their data journey, they assess business needs and propose fit-for-purpose architectural solutions to drive data-driven decision-making and innovation.

Responsibilities

To be a suitable candidate for this Data Architect role you will have the experience to:

• Demonstrated deep expertise in delivering enterprise-scale data analytics solutions end-to-end using Databricks, with a focus on Lakehouse Architecture and ML/AI-driven analytics.
• Several years of experience in data analytics, consulting, or a related field.
• Strong expertise in designing and implementing Lakehouse Architectures for both structured and unstructured data.
• Solid understanding of data modelling techniques, including 3NF, Kimball, and Data Vault.
• Experience in exposing Delta Lakehouse architecture to reporting tools such as PowerBi and Tableau.
• Experience in Data Engineering using Databricks, Spark, Delta Lake, and PySpark.
• Experience in building scalable ETL pipelines using Databricks workflows and Delta Live Tables.
• Strong programming skills in Python, Scala, or SQL for data engineering.
• Hands-on experience with at least one of core cloud platforms (Azure, AWS, or GCP), including storage, compute, and networking and implications of using Databricks on each of these related platforms.
• Knowledge of Databricks security best practices, including RBAC, IAM, and encryption.
• Excellent problem-solving, analytical, and communication skills.

Desirable experience:

• Experience with Data Governance tools such as Unity Catalog or Microsoft Purview.
• Hands-on experience with Azure Infrastructure and Networking to setup Databricks.
• Exposure to Machine Learning and AI solutions using Databricks MLflow and AutoML.
• Experience in DevOps, CI/CD, and Infrastructure as Code (Terraform, Databricks Asset bundles or ARM templates).

Certifications:

• Databricks Certified Data Engineer Associate / Professional
• Databricks Certified Machine Learning Associate / Professional
• Databricks Certified Generative AI Fundamentals
• Databricks Certified Lakehouse Fundamentals

Requirements

• Architect and implement Databricks Lakehouse solutions, optimising data ingestion, processing, storage, and analytics.
• Apply domain knowledge to recommend best practices and innovative architectures for modern data platforms.
• Develop strong working relationships with clients, present and justify architectural decisions to stakeholders at different levels of the organisation.
• Inform client data strategies, encouraging the adoption of best practices and governance models. Our architects must have the ability to challenge clients and colleagues around delivery approach or content of deliverables.
• Gather requirements from business and technical stakeholders.
• Lead architectural engagements, either directly or as part of a larger programme of work and take ownership for the successful delivery of customer value within budget, time and scope ensuring high standards of architecture, performance, and security.
• Debug and optimise Databricks solutions for performance and cost-efficiency.
• Optimise resource consumption and costs in Databricks environments.
• Implement governance, security, and compliance best practices for Databricks and cloud-based data ecosystems.
• Ensure data quality, lineage, and cataloging using tools such as Unity Catalog and Microsoft Purview.
• Develop and enforce CI/CD pipelines for Databricks workloads using Databricks Repos, GitHub Actions, or Azure DevOps.
• Conduct testing, documentation, and knowledge transfer to ensure operational sustainability.
• Contribute to the Architecture Practice, developing reusable architecture patterns and resources for Databricks solutions.

Pre‑sales activities

• Act as a solution architect in pre‑sales, partnering with sales and delivery to shape Databricks‑based solutions that address client data and AI challenges.
• Lead technical input to RFI and RFP responses, including discovery questions, target‑state architecture, delivery approach, risks, assumptions and high‑level estimates.
• Present and pitch architectural solutions to senior technical and business stakeholders, clearly articulating design decisions, value, trade‑offs and alignment to Databricks best practices.
• Design and deliver Proofs of Concept (PoCs) using Databricks Lakehouse, Azure services to validate use cases, demonstrate capability and accelerate client decision‑making.
• Support early‑stage client discovery, translating business objectives into secure, scalable and governed architectures, with consideration for cost optimisation, performance and enterprise governance (e.g. Unity Catalog etc).

Benefits

• Work on meaningful, complex data and AI programmes with leading UK organisations
• Be part of a collaborative, people‑first consultancy that invests in your growth and development
• Join a business where expertise, curiosity and impact genuinely matter