IN_Senior Associate_Azure Data Engineer_D&A_Advisory_PAN India
Description
Job Description & Summary:
PwC India is looking for a highly skilled Databricks and Microsoft Fabric Technical Consultant with mandatory hands-on experience in Databricks, PySpark, and Delta Lake. This is a purely technical role focused on customizing, enhancing, and integrating solutions
Job Position Title: IN_Senior Associate_Azure Data Engineer_D&A_Advisory_PAN India
Responsibilities:
- Design and develop end-to-end data pipelines using Databricks (PySpark, Delta Lake)
- Build and manage data solutions on Microsoft Fabric (Data Factory, Lakehouse, Warehousing)
- Integrate data from multiple sources (SQL, APIs, cloud storage) into unified data platforms
- Optimize data processing performance, scalability, and cost efficiency
- Implement data quality, governance, and security best practices
- Collaborate with analytics and BI teams to enable reporting and AI/ML use cases
- Support CI/CD, deployment, and monitoring of data workflows
Mandatory skill sets:
- Strong experience in Databricks, PySpark, and Delta Lake
- Hands-on experience with Microsoft Fabric ecosystem
- Proficiency in SQL and Python
- Understanding of data warehousing, ETL/ELT, and lakehouse architecture
- Familiarity with version control and DevOps practices
Preferred skill sets:Databricks, PySpark, and Delta Lake
Years of experience required: 4-7 Years
Education qualification: BE, B.Tech, MCA, MBA, M.Tech