Data Architect

• 12+ years of Data Engineering and Architecture experience with at least 5+ years of Databricks architecture experience.
• Strong experience in large-scale cloud data platform modernization programs.
• Proven experience migrating on-premises or Synapse-based platforms to Databricks Lakehouse.
• Experience designing enterprise-scale Data Mesh and Data Product architectures.
• Banking and Financial Services domain experience preferred.
• Experience leading architecture governance, design reviews, and technical strategy discussions.

Success Measures

• Successful modernization of legacy data platforms onto Databricks Lakehouse.
• Improved platform scalability, performance, and cost efficiency.
• Establishment of reusable architecture patterns and engineering standards.
• Accelerated delivery through automation, DataOps, and CI/CD adoption.
• Secure, governed, and compliant enterprise data platform implementation.
• Increased adoption of Data Products and self-service analytics capabilities.

Key Skills Required

Databricks & Lakehouse

• Databricks Lakehouse Platform
• Delta Lake
• Delta Live Tables (DLT)
• Unity Catalog
• Databricks SQL
• Databricks Workflows
• Serverless Compute
• MLflow

Data Engineering & Processing

• PySpark
• Spark SQL
• Python
• Structured Streaming
• Auto Loader
• Change Data Capture (CDC)
• Delta Change Data Feed (CDF)
• Data Product Design

Architecture & Modernization

• Lakehouse Architecture
• Medallion Architecture
• Data Mesh Principles
• Enterprise Data Architecture
• Migration Strategy & Modernization
• Data Modeling
• Distributed Computing

Performance & Optimization

• Liquid Clustering
• Partitioning Strategies
• Z-Ordering
• Query Performance Tuning
• Workload Optimization
• Cost Optimization
• Capacity Planning

DevOps & Automation

• Git Integration
• Databricks Asset Bundles (DAB)
• Terraform
• Azure DevOps
• CI/CD Pipelines
• Infrastructure as Code (IaC)

Cloud & Platform

• Microsoft Azure
• Azure Data Lake Storage Gen2
• Azure Data Factory
• Azure Entra ID
• Event Hub
• Monitoring & Observability Frameworks