Databricks Solution Lead
- Build ML ready datasets
- Build batch data pipelines
- Build real-time data pipelines
- Collaborate with stakeholders to translate business needs
- Design lakehouse platforms on Databricks
- Develop ingestion frameworks for structured data
- Develop ingestion frameworks for unstructured data
- Enable data science workflows
- Implement CI/CD and DevOps best practices
- Implement Unity Catalog
- Implement data governance and quality checks
- Implement scalable data platforms
- Lead and mentor data engineers
- Maintain metadata and data lineage
- Manage security and privacy compliance
- Optimize performance, cost, and reliability
- Own end-to-end project delivery
- Set up monitoring and observability
- Support real time analytics with streaming
Perks/Benefits:
- AI Driven Learning Platform
- Career development training
- Discounted health insurance
- Discounts on products and services
- Industry partner training
- Paid parental leave
- Recognition for high performance
- Wellbeing initiatives