Codvo.ai - Databricks Architect
Description
Role : Databricks Architect
CODVO.AI is looking for an experienced Databricks Architect to design, implement, and optimize scalable enterprise data solutions. The role involves leading data architecture initiatives, developing high-performance data pipelines, and guiding engineering teams in building secure, cost-effective data platforms.
Key Responsibilities :
- Design enterprise-grade data lakes, lakehouses, and analytics platforms using Databricks.
- Develop and optimize data pipelines using Apache Spark, Delta Lake, Python, and SQL.
- Lead data engineering projects across architecture, implementation, and deployment.
- Establish best practices for data governance, security, performance, and cost optimization.
- Troubleshoot complex technical challenges and provide architectural guidance to engineering teams and clients.
- Mentor engineers, conduct code reviews, and promote effective data engineering practices.
- Collaborate with business and technical stakeholders to align data architecture with organizational requirements.
Required Skills and Experience :
- 12+ years of overall professional experience, with at least 3 years of hands-on experience in Databricks and data engineering.
- Strong proficiency in Apache Spark, Python, and SQL.
- Experience designing and managing ETL/ELT pipelines.
- Expertise in Delta Lake and data lakehouse architecture.
- Understanding of data governance, data security, and performance optimization.
- Experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
- Databricks Associate or Professional certification.
- Strong problem-solving, communication, and stakeholder-management skills.
- Ability to provide technical leadership and architectural direction to engineering teams.
Role Expectations :
The candidate will lead enterprise data architecture and engineering initiatives, ensuring scalable, secure, high-performing, and cost-effective data platforms while supporting technical teams and client requirements.