Senior Data Engineer - Azure Databricks & Data Governance
Summary
The Senior Data Engineer will design and optimize scalable data pipelines using Azure Data Factory, Databricks, and Spark. The role focuses on delivering clean datasets for analytics while ensuring compliance with financial services data governance and security standards.
Jobtailor is seeking a data engineer in Brisbane to design, build, and optimize scalable data pipelines using Azure Data Factory, Databricks, and Spark. You will craft PySpark notebooks and collaborate with data scientists to deliver clean datasets for analytics and reporting.
The role emphasizes data governance, security, and compliance with financial services regulations, with opportunities to optimize Spark performance and participate in agile ceremonies.