Databricks Technical Platform Architect_Immediate_Remote
Description
Title : Databricks Architect
Location : Remote
Experience : 8-15 Years
Mandatory skills : Databricks (70%), AWS architecture (30%), AI/ML, Gen AI
JOB OVERVIEW
We are seeking an experienced, hands-on Databricks Technical Platform Architect to design, implement, modernize, and optimize enterprise-scale Data, Analytics & AI platforms, with a primary focus on Databricks (70%) and AWS Cloud Services (30%).
The ideal candidate will possess strong technical expertise in Databricks platform architecture, AWS cloud infrastructure and service enablement, platform engineering, automation, performance optimization, and emerging AI technologies. The role requires practical experience in enabling, integrating, and scaling enterprise platform capabilities rather than focusing primarily on data pipeline development.
The architect will contribute to building scalable, secure, reliable, and future-ready platforms while collaborating with dedicated Architecture Leads across Governance, Security & FinOps; Ingestion & Integration; and Self-Service Enablement to ensure architectural consistency and seamless platform integration.
QUALIFICATIONS
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 7+ years of IT experience, including 3+ years in Cloud/Data Platform Architecture and 5+ years of hands-on Databricks Platform Architecture experience.
- Proven experience designing, implementing, configuring, and supporting enterprise-scale Databricks platforms on AWS.
- Strong hands-on expertise in AWS cloud infrastructure, service enablement, networking, connectivity, and platform integration.
- Experience with Terraform, Infrastructure as Code, Git, CI/CD, platform automation, and multi-environment deployment management.
- Strong understanding of distributed computing, Apache Spark, Delta Lake, cloud-native architecture, and enterprise platform integration.
- Experience enabling enterprise AI/ML, Generative AI, and advanced analytics platform capabilities.
- Demonstrated ability to evaluate technical solutions, develop architecture designs, troubleshoot complex platform issues, and implement enterprise technology standards.
- Strong technical problem-solving, architecture documentation, communication, and cross-functional collaboration skills.
REQUIRED TECHNICAL EXPERIENCE & EXPERTISE :
1. Databricks Platform Architecture & Engineering (Primary 70%)
- Extensive hands-on experience designing, architecting, implementing, and modernizing enterprise-scale Databricks Lakehouse platforms on AWS.
- Strong expertise in Databricks account and workspace architecture, compute configurations, SQL Warehouses, serverless computing, workload isolation, and multi-environment deployments.
- Experience with Delta Lake, Unity Catalog, Delta Sharing, Lakehouse Federation, and cross-workspace/catalog configurations.
- Expertise in platform provisioning, configuration management, scalability, capacity planning, high availability, and disaster recovery architecture.
- Experience enabling and integrating Databricks platform services supporting Data Engineering, Analytics, AI/ML, and Generative AI workloads.
- Hands-on experience with Terraform, Infrastructure as Code, Databricks Asset Bundles, Git, CI/CD automation, and standardized platform deployment and release management.
- Strong understanding of Apache Spark architecture, compute performance optimization, platform observability, troubleshooting, and operational reliability.
- Experience evaluating, piloting, and enabling emerging Databricks technologies and platform capabilities for enterprise adoption.
2. AWS Cloud Architecture & Service Enablement (Secondary – 30%)
- Strong hands-on experience architecting, provisioning, configuring, and enabling AWS cloud services supporting enterprise Data, Analytics & AI platforms.
- Practical experience with AWS services, including:
oCompute & Processing: EC2, Lambda, EMR, ECS/EKS.
oStorage & Databases: S3, Redshift, RDS, Aurora.
oNetworking & Connectivity: VPC, AWS PrivateLink, Transit Gateway, Route 53, VPC Endpoints.
oIdentity & Security: IAM, KMS, Secrets Manager.
oIntegration & Orchestration: Step Functions, EventBridge, API Gateway, AWS Transfer Family.
oMonitoring & Automation: CloudWatch, CloudTrail, CloudFormation, Terraform.
- Experience with end-to-end AWS service enablement, including infrastructure provisioning, configuration, networking, connectivity, security integration, automation, and production readiness.
- Ability to design and implement secure, scalable integrations between AWS services, Databricks, and enterprise applications.
- Strong troubleshooting experience across AWS infrastructure, networking, service connectivity, permissions, and cloud platform integrations.
- Experience implementing reusable cloud architecture patterns, automated provisioning, and standardized service deployment frameworks.
3. AI Platform Architecture & Emerging Technology Enablement
- Experience enabling Databricks Unity AI Gateway, including LLM endpoint management, API-based model access, authentication, usage monitoring, and integration with external AI applications.
- Experience enabling Databricks Omnigent (AI Agent Framework and Meta-Harness), including agent orchestration, integration, and Model Serving endpoints.
- Understanding of Ontology and Semantic Layer enablement, including business metadata, semantic models, entity relationships, and integration with Databricks AI/BI Genie.
- Familiarity with Databricks Mosaic AI, MLflow, Model Serving, Vector Search, and enterprise GenAI platform architecture.
- Experience integrating Databricks-hosted AI services with AWS Bedrock, external LLM providers, APIs, and enterprise AI applications.
- Ability to evaluate emerging AI technologies, conduct technical POCs, and establish scalable, secure, and reusable AI platform architecture patterns.
Interested candidates please connect on Sonali - 8879984232 OR Share updated profile on sonali.patne@enlinkit.com
Skills
- AI
- Analytics
- API
- API Gateway
- Aurora
- Authentication
- Automation
- AWS
- AWS Bedrock
- CI/CD
- Cloud
- Cloud Native
- CloudFormation
- CloudTrail
- CloudWatch
- Data Engineering
- Data Pipelines
- Databricks
- Delta Lake
- Distributed Computing
- EC2
- ECS
- EKS
- Eventbridge
- FinOps
- Generative AI
- Git
- IAM
- Infrastructure as Code
- Lakehouse
- Lambda
- LLM
- Machine Learning
- MLflow
- Networking
- Observability
- RDS
- Redshift
- S3
- Serverless
- Spark
- SQL
- Terraform
- Unity
- Unity Catalog
- Vector Search
- VPC
Sign in to read and join the discussion.