Azure Data Engineer
Summary
Design and maintain Azure-based ETL/ELT pipelines using Data Factory and Databricks, optimize SQL queries, and implement CI/CD with Azure DevOps.
Must-Have
- Over 3 years of hands‑on experience with ETL/ELT tooling, Databricks, SQL, and stored procedures.
- Strong SQL tuning/optimization skills.
- Experience with Azure Data Factory and Databricks; familiarity with Azure SQL or SQL Managed Instance.
- Working knowledge of Azure DevOps (Repos, CI/CD pipelines).
- Understanding data modeling and normalization.
- Experience with Agile methodologies and collaboration tools (JIRA, Confluence, Kanban).
- Vendor management: experience coordinating with external vendors, managing deliverables, and tracking SLAs; ability to engage vendors for data platform needs.
Role descriptions / Expectations from the Role
- Design, develop, and maintain ETL/ELT pipelines on Microsoft Azure (Azure Data Factory, Databricks, Azure SQL / Azure SQL Managed Instance).
- Optimize SQL queries and stored procedures for performance, scalability, and reliability.
- Collaborate with data modelers to understand data structures, normalization, and data quality requirements.
- Implement CI/CD pipelines and deployment strategies using Azure DevOps (Repos, pipelines, release management).
- Monitor, troubleshoot, and improve data pipelines; address data quality issues and incidents.
- Support the Data Tech Lead and internal AXA teams with technical discussions and development work.
- Coordinate with Group Office tech team and other local IT teams (architects, BAs, etc.) as needed.
- Participate in Agile ceremonies and use collaboration tools (JIRA, Confluence, Kanban boards).