Databricks Solution Architect (Data & AI)
We are seeking a Databricks Solution Architect to join EPAM's Data & AI practice in North America. You will design and deliver governed data, analytics, and AI platforms on Databricks for enterprise clients, and you will join pre-sales pursuits to shape solutions, estimates, and proposals.
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture, and you will collaborate with multinational teams on innovative projects while continuing to learn and grow.
Req.#1112994925
Responsibilities
- Design end to end Lakehouse architectures on Databricks (Azure, AWS, or GCP), covering ingestion, medallion modeling, serving, governance, and cost control
- Lead discovery and architecture workshops with client executives and engineering teams, and present proposed solutions and roadmaps clearly
- Partner with sales and the Databricks field team on pursuits: shape solutions, answer RFPs, build proposals, estimate effort, and run POCs
- Define target architectures and migration paths from other solutions to Databricks
- Architect governance with Unity Catalog, including access control, lineage, data sharing, and compliance with client security requirements
- Design AI solutions, including RAG, agentic workflows, Model Serving, Vector Search, and MLflow based LLMOps and MLOps
- Guide delivery teams through build and go live, and review, audit, and improve existing designs and system architectures
- Run performance tuning, optimization, and FinOps reviews for Spark and Databricks SQL workloads
Requirements
- 8+ years of experience in data engineering, data architecture, or software development, including 3+ years designing solutions on Databricks
- Hands-on proficiency in Python and SQL; Scala is a plus
- Deep knowledge of Apache Spark, Delta Lake, Lakeflow (Spark Declarative Pipelines and Jobs), Databricks SQL, and Unity Catalog
- Experience with at least one major cloud (Azure, AWS, or GCP) and its data services, networking, and security model
- Proven experience leading large, client driven implementation projects, including pre-sales and proposal work
- Experience with streaming and messaging tools such as Kafka, Event Hubs, Kinesis, or Flink
- Knowledge of design patterns, CI/CD, infrastructure as code (Terraform), and Databricks Asset Bundles
- Working knowledge of AI on Databricks (Mosaic AI, Agent Bricks, MLflow)
- Strong communication and consulting skills, with fluent English (B2+ or higher)
- Authorization to work in the US or Canada
Nice to have
- Databricks Solution Architect Champion certification (a big plus), plus certifications such as Data Engineer Professional, Generative AI Engineer Associate, or Machine Learning Professional
Benefits
- Medical, Dental and Vision Insurance (Subsidized)
- Health Savings Account
- Flexible Spending Accounts (Healthcare, Dependent Care, Commuter)
- Short-Term and Long-Term Disability (Company Provided)
- Life and AD&D Insurance (Company Provided)
- Employee Assistance Program
- Unlimited access to LinkedIn learning solutions
- Matched 401(k) Retirement Savings Plan
- Paid Time Off – the employee will be eligible to accrue 15-25 paid days, depending on specific level and tenure with EPAM (accrual eligibility may change over time)
- Paid Holidays - nine (9) total per year
- Legal Plan and Identity Theft Protection
- Accident Insurance
- Employee Discounts
- Pet Insurance
- Employee Stock Purchase Program
- If otherwise eligible, participation in the discretionary annual bonus program
- If otherwise eligible and hired into a qualifying level, participation in the discretionary Long-Term Incentive (LTI) Program
Skills
- Agentic AI
- AI
- Analytics
- AWS
- Azure
- CI/CD
- Cloud
- Data Engineering
- Databricks
- Delta Lake
- Design Patterns
- FinOps
- Flink
- GCP
- Generative AI
- Infrastructure as Code
- Kafka
- Kinesis
- Lakehouse
- LLMOps
- Machine Learning
- MLflow
- MLOps
- Networking
- Pre-sales
- Python
- Scala
- Spark
- SQL
- Terraform
- Unity
- Unity Catalog
- Vector Search