Azure Data Engineer - ETL/ELT, Databricks & CI/CD
Summary
Builds and maintains ETL/ELT data pipelines on Microsoft Azure using Azure Data Factory and Databricks, optimizes SQL performance, and deploys via CI/CD with Azure DevOps. Day to day involves monitoring pipelines, fixing data quality issues, and collaborating in Agile ceremonies using JIRA and Confluence.
EIRE Systems (Hong Kong) Limited is seeking a skilled data engineer to design, develop, and maintain ETL/ELT pipelines on Microsoft Azure, including Azure Data Factory and Databricks. You will optimize SQL performance, collaborate with data modelers, and implement CI/CD deployment strategies using Azure DevOps.
You will monitor pipelines, address data quality issues, and coordinate with local IT teams while participating in Agile ceremonies and using JIRA and Confluence for collaboration.