Azure Data Engineer - Databricks
Summary
Senior data engineer designing secure, scalable Azure data platforms (data lakes, lakehouses, warehouses) and building ETL/ELT pipelines with Databricks, ADF, PySpark, Snowflake, and Synapse, plus governance, CI/CD, and mentoring. Hybrid/remote from Pune on a 2:00-11:00 PM IST shift.
Experience: 7+ years in Azure Data Engineering
Location: Pune (relocation assistance available)
Work mode: Hybrid / Remote
Shift: 2:00 PM - 11:00 PM IST
Notice period: Immediate joiners preferred
Key skills: Azure, Databricks, Microsoft Fabric, Snowflake, ADF, Synapse, PySpark, SQL, ETL/ELT, Azure DevOps, and Git.
Good to have: Airflow, Delta Lake, Unity Catalog, Power BI, Terraform, Kafka/Event Hubs, Python, and data modeling.
Key responsibilities:
- Design secure, scalable Azure data platforms, including data lakes, lakehouses, and data warehouses.
- Build and maintain ETL/ELT pipelines using ADF, Databricks, PySpark, and related Azure services.
- Create ingestion frameworks for data from databases, APIs, SAP, Salesforce, SharePoint, and files.
- Design fact and dimension models, including SCD Type 1 and Type 2.
- Optimize Spark jobs, SQL queries, and cloud resources for performance and cost.
- Implement data security, governance, monitoring, quality, and CI/CD practices.
- Lead architecture and code reviews, prepare design documents, and mentor engineering teams.