Azure Data Engineer
Summary
Design, build, and maintain ETL/ELT data pipelines on Microsoft Azure (Data Factory, Databricks, Azure SQL), optimize SQL queries and stored procedures, and implement CI/CD with Azure DevOps. A consulting role working with AXA insurance teams in an Agile setup.
Salary: $40,000 – $45,000 per month
Required Technical Skill Set
Microsoft Azure (Azure Data Factory, Databricks, Azure SQL / Azure SQL Managed Instance).
Must-Have
Over 3 years of hands-on experience with ETL/ELT tooling, Databricks, SQL, and stored procedures.
Strong SQL tuning/optimization skills.
Experience with Azure Data Factory and Databricks; familiarity with Azure SQL or SQL Managed Instance.
Working knowledge of Azure DevOps (Repos, CI/CD pipelines).
Understanding data modeling and normalization.
Experience with Agile methodologies and collaboration tools (JIRA, Confluence, Kanban).
Vendor management: experience coordinating with external vendors, managing deliverables, and tracking SLAs; ability to engage vendors for data platform needs.
Role descriptions / Expectations from the Role
Design, develop, and maintain ETL/ELT pipelines on Microsoft Azure (Azure Data Factory, Databricks, Azure SQL / Azure SQL Managed Instance).
Optimize SQL queries and stored procedures for performance, scalability, and reliability.
Collaborate with data modelers to understand data structures, normalization, and data quality requirements.
Implement CI/CD pipelines and deployment strategies using Azure DevOps (Repos, pipelines, release management).
Monitor, troubleshoot, and improve data pipelines; address data quality issues and incidents.
Support the Data Tech Lead and internal AXA teams with technical discussions and development work.
Coordinate with Group Office tech team and other local IT teams (architects, BAs, etc.) as needed.
Participate in Agile ceremonies and use collaboration tools (JIRA, Confluence, Kanban boards)