Azure Databricks Solution Architect
Posted Updated
Description
Job Description
Seeking an experienced Azure Databricks Solution Architect to design, develop, architect, and deliver scalable cloud-native data platforms on Azure. The role requires strong expertise in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, and enterprise data engineering, coupled with solution architecture and technical leadership capabilities.
- Design and develop scalable data pipelines using Databricks for ETL processing across diverse data sources
- Build and optimize large-scale data workflows using PySpark and Python
- Ensure performance tuning, debugging, and optimization of data pipelines
- Collaborate with cross-functional teams to enable data integration and analytics solutions
- Support implementation of data lake architectures leveraging Delta Lake and cloud platforms
- Knowledge of CI/CD practices and Agile delivery models
- Strong analytical and problem-solving capabilities
- Relevant experience in data engineering with strong exposure to Databricks and PySpark
- Proven ability to handle large-scale structured and unstructured data pipelines
- Experience working in cloud environments, preferably Azure
- Exposure to performance optimization and scalable data processing architectures
Key Competencies
- Solution Architecture
- Databricks – Data Engineering
- Azure Data Factory
- Stakeholder Management
- Technical Leadership
- Agile Delivery
- Problem Solving & Innovation
- Databricks Developer / Data Engineering certifications
- Azure Data Engineering certifications
Skills
Sign in to read and join the discussion.