Senior Databricks Solution Architect
Posted Updated
Description
Unison Group is seeking a Senior Databricks Architect to design, implement, and optimize enterprise-scale data platforms using the Databricks Lakehouse Platform. The ideal candidate will possess deep expertise in Databricks architecture, Apache Spark, Delta Lake, data engineering, and cloud environments.
The role involves leading end-to-end Databricks implementations, defining workspace and governance models, and delivering scalable pipelines.
Design and architect Databricks Lakehouse solutions for large-scale data platforms. Lead end-to-end Databricks implementation, including architecture, development, deployment, and optimization. Define workspace architecture, cluster strategies, security models, and operational standards. Design scalable data pipelines using Databricks, Spark, PySpark, SQL, and Delta Lake. Implement data ingestion frameworks supporting batch and real-time processing. Design Delta Lake architectures with Bronze/Silver/Gold layers and data quality frameworks. Perform Databricks performance tuning: cluster, Spark, query, and cost optimization. Implement Databricks governance using Unity Catalog, access controls, data lineage, and audit capabilities. Lead migrations from legacy data platforms to Databricks Lakehouse. Define best practices for Databricks CI/CD, DevOps, and environment management. Collaborate with data engineers, data scientists, analysts, and enterprise architects. Provide architecture documentation and design reviews. Strong experience in data engineering, big data, or solution architecture. Hands-on experience with Databricks Platform. Experience designing and delivering enterprise Databricks solutions.Skills
Sign in to read and join the discussion.