Assistant Manager - Databricks Azure
- Build Power BI reports and dashboards
- Build data ingestion and analytical pipelines
- Build medallion architecture
- Create data quality frameworks
- Design and maintain Databricks data pipelines
- Develop and deploy ETL pipelines on Azure
- Develop data streaming pipelines
- Implement Azure data security with RBAC and IAM
- Implement data ingestion with Azure services
- Implement metadata-driven ingestion
- Process large datasets using Apache Spark
- Transform data using SCD type 1 and SCD type 2