Senior Azure Data Engineer
Posted Updated
Summary
Senior Azure Data Engineer in Pune who owns end-to-end data solutions on Azure — designing, building, and maintaining data pipelines and platforms with Data Factory, Databricks, Delta Lake, and Snowflake using Python, SQL, and PySpark, backed by CI/CD and DevOps/DataOps practices.
About the Role
Key Responsibilities
Required Skills & Experience
Must Have
Good to Have
Additional Skills
Role Scope
The Senior Azure Data Engineer is responsible for designing, developing, and maintaining scalable, secure, and high-performance data solutions on the Azure platform. This role involves end-to-end ownership of data pipelines, architectural decision-making, and ensuring best practices in performance, cost optimization, and data security.
Key Responsibilities
- Design, build, and maintain end-to-end Azure data solutions
- Develop and manage data pipelines and data platforms
- Act as a technical authority for data engineering within the team
- Collaborate with Product Owners, Architects, and stakeholders
- Ensure high-quality, secure, and scalable code delivery
- Handle incident management, root cause analysis, and optimization
- Define and enforce data engineering standards & best practices
- Mentor junior engineers and contribute to team growth
- Drive continuous improvement in platform performance and cost
- Document architecture, processes, and technical solutions
Required Skills & Experience
Must Have
- 8+ years of experience in Data Engineering & Cloud Platforms
- Strong expertise in Azure Data Platform, including:
- Azure Data Factory
- Databricks
- Delta Lake
- Snowflake
- Hands-on experience with Python, SQL, PySpark
- Strong knowledge of DevOps/DataOps practices
- CI/CD pipelines
- Infrastructure as Code
- Azure DevOps / Jenkins / Git
- Experience in data validation, testing, and performance optimization
- Strong understanding of cloud architecture, data security & governance
- Experience working in Agile / Scrum / Hybrid environments
- Excellent problem-solving and analytical skills
- Ability to make architectural decisions and communicate effectively
Good to Have
- Knowledge of Java / .NET
- Exposure to Azure AI services (Azure ML, OpenAI, Cognitive Services)
- Understanding of AI/ML data pipelines and integrations
Additional Skills
- Strong communication and stakeholder management
- Ability to handle multiple projects simultaneously
- Analytical mindset with focus on performance & cost optimization
- Experience mentoring and guiding teams
Role Scope
- Part of the Global IT / Product Engineering team
- Responsible for end-to-end data solution lifecycle
- Works closely with onshore & offshore teams
- Drives technical decisions, innovation, and continuous improvement