Databricks Data Architect
Description
We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the practice: leading solution design on client engagements, owning and defending enterprise architectures in presales, and driving large-scale migration and cloud transformation programs. This is a hands-on leadership role for a builder who can equally command a whiteboard in front of a CTO and a Spark UI when a pipeline misbehaves. You will also shape the practice itself—mentoring engineers, creating accelerators and reusable assets, and converting delivery success into case studies and go-to-market offerings.
Architecture and delivery
- Own end-to-end architecture and design decisions on Databricks engagements, ensuring solutions are secure, scalable, performant, and aligned with Lakehouse best practices.
- Lead delivery of production-grade data platforms, including ingestion, transformation, orchestration, governance through Unity Catalog, and downstream BI/ML enablement.
- Lead large-scale migrations of legacy data warehouses, ETL systems, Hadoop, and on-premises estates, as well as cloud transformation projects to Databricks on Azure, AWS, or GCP, including assessment, wave planning, and cutover.
- Stay hands-on with performance tuning, debugging, code and design reviews, and setting engineering standards for the team.
Presales and stakeholder management
- Own and defend enterprise solution designs in front of architecture boards, CIOs, and CTOs—and enjoy it.
- Drive presales end to end, including discovery, solutioning, estimation, proofs of concept, RFPs, and proposals that convert.
- Translate complex technical trade-offs into decisions executives can act on, communicating effectively from the engineering team to the boardroom.
Who thrives here
- A builder at heart, with 10+ years in data engineering or architecture and 3+ years working with Databricks at enterprise scale, who is still happiest with hands on the keyboard.
- Deep Spark expertise in architecture, performance tuning, streaming, and debugging—the advanced skills that separate architects from diagram-drawers.
- Lakehouse fluency, including Medallion architecture, Delta Lake, Unity Catalog, governance, and orchestration tools such as Workflows, DLT/Lakeflow, Airflow, and ADF. Microsoft Fabric exposure is a bonus.
- Experience leading large transformation programs, with the scars and success stories to show for it.
- Presales instinct: you do not just design solutions; you sell them, price them, and defend them under fire.
- Modern technical skills, including strong Python, SQL, or Scala; CI/CD for data platforms; and experience integrating ML/AI, including MLflow and LLM APIs such as OpenAI and Anthropic.
- Databricks Data Engineer Professional or Solution Architect accreditations are strongly preferred.
- Founder energy: curiosity, adaptability, and the drive to build offerings, not just deliver projects.
Requirements
- Experience with DPP (Databricks Partnered Projects) projects.
Skills
- AI
- Airflow
- Anthropic
- API
- AWS
- Azure
- CI/CD
- Cloud
- Data Engineering
- Databricks
- Delta Lake
- ETL
- GCP
- Go-to-Market
- Hadoop
- Lakehouse
- LLM
- Machine Learning
- Medallion Architecture
- Microsoft Fabric
- MLflow
- OpenAI
- Pre-sales
- Python
- RFx (RFQ/RFP/RFI)
- Scala
- Solution Design
- Spark
- SQL
- Stakeholder Management
- Unity
- Unity Catalog
Sign in to read and join the discussion.