Data Engineer | Azure & Databricks Focus
Summary
Data engineer on a Hong Kong team delivering a large enterprise data transformation programme on Azure. Day to day: designing and maintaining ETL/integration pipelines with Azure Databricks, PySpark and Azure Data Factory, migrating and validating critical data assets, and supporting Power BI reporting and data quality.
Join a highly skilled data engineering team delivering a major enterprise transformation programme across a modern Azure data platform.
You’ll work alongside experienced engineers on large-scale data initiatives, helping modernise reporting capabilities and build scalable cloud-based data solutions using Azure Databricks, PySpark and Azure Data Factory.
This is an opportunity to work on complex enterprise data challenges, gain exposure to multiple business domains, and contribute to a highly visible transformation programme within a collaborative engineering environment.
Responsibilities
Design, build and maintain scalable ETL and data integration pipelines across multiple business domains.
Develop and optimise data solutions using Azure Databricks, PySpark and Azure Data Factory.
Support enterprise reporting and data transformation initiatives by migrating, validating and enhancing critical data assets.
Collaborate with business stakeholders, analysts and technical teams to gather requirements and deliver scalable data solutions.
Participate in testing, validation, troubleshooting and production support activities across data pipelines and reporting solutions.
Contribute to architecture discussions, code reviews and continuous improvement of engineering standards.
Support Power BI reporting, dashboard enhancements and analytics initiatives where required.
Ensure data quality, integrity and reliability through validation, monitoring and issue resolution.
Requirements
Strong hands‑on experience with Azure Databricks and PySpark.
Experience building and supporting data pipelines using Azure Data Factory and Azure Data Lake.
Strong SQL skills and experience working with large-scale datasets.
Experience supporting testing, data validation, troubleshooting or production support activities.
Exposure to Power BI or other reporting/analytics platforms is advantageous.
4-6 years of experience in Data Engineering, ETL or Data Integration.
Kowloon City, Kowloon City District, HK
TransUnion Limited