Azure Databricks Data Engineer - Pipelines, Quality & Governance
Summary
Data engineer designing and maintaining ETL/ELT pipelines on Azure Databricks for insurance data, using PySpark/Scala, Python, Informatica, and GitHub Actions.
IT Channel (Asia) Limited in Hong Kong seeks a data engineer to design, build, and maintain scalable ETL/ELT pipelines on Azure Databricks for diverse insurance data, collaborating with data architects and stakeholders to deliver robust assets. You will ensure data quality, governance, and security while integrating batch and streaming sources such as Kafka.
Proficiency in PySpark/Scala, Python, and Informatica, plus CI/CD with GitHub Actions, is essential for timely analytics and regulatory