Azure Databricks Developer
- Architect data warehouse and lakehouse
- Build CI/CD pipelines for deployments
- Build ELT/ETL pipelines
- Collaborate with BI, Analytics, and business teams
- Create technical documentation and operational guides
- Design data engineering solutions
- Develop PySpark transformations
- Ensure data security encryption and access control
- Implement Delta Lake features
- Implement data quality checks
- Integrate data from APIs and third party sources
- Manage Databricks clusters jobs and notebooks
- Orchestrate workflows in Azure Data Factory
- Perform performance tuning and optimization