Data Engineer
Summary
An experienced Data Engineer joins a growing data team to build and maintain secure, scalable ETL/ELT pipelines and curated data models in Azure Databricks, integrating ERP and SQL sources and powering Power BI reporting across multiple businesses in Victoria, Australia.
We're looking for an experienced Data Engineer to join a growing data team and help build a modern, scalable data environment from the ground up.
Working closely with the Head of Data and Senior Data Engineer, you'll be responsible for the hands-on development, testing and maintenance of secure and scalable solutions using Azure Databricks.
The environment spans multiple businesses, ERP platforms and operational systems, providing plenty of technical complexity and variety.
Key responsibilities:
- Building, testing and maintaining ETL and ELT pipelines in Azure Databricks
- Integrating data from ERP platforms, SQL databases and other operational systems
- Supporting source-to-target mappings, transformation logic and business rules
- Developing curated data models and datasets for reporting, dashboards and analytics
- Implementing data security and access controls including RLS, security groups and access policies
- Supporting data governance, quality, privacy and documentation standards
- Automating manual data aggregation and reporting processes, including Excel-dependent financial and month-end activities
- Working with business and technology stakeholders to turn agreed requirements into reliable technical solutions.
We're looking for an experienced Data Engineer to join a growing data team and help build a modern, scalable data environment from the ground up.
Working closely with the Head of Data and Senior Data Engineer, you'll be responsible for the hands-on development, testing and maintenance of secure and scalable solutions using Azure Databricks.
The environment spans multiple businesses, ERP platforms and operational systems, providing plenty of technical complexity and variety.
Key responsibilities:
- Building, testing and maintaining ETL and ELT pipelines in Azure Databricks
- Integrating data from ERP platforms, SQL databases and other operational systems
- Supporting source-to-target mappings, transformation logic and business rules
- Developing curated data models and datasets for reporting, dashboards and analytics
- Building efficient backend datasets for Power BI
- Implementing data security and access controls including RLS, security groups and access policies
- Supporting data governance, quality, privacy and documentation standards
- Automating manual data aggregation and reporting processes, including Excel-dependent financial and month-end activities
- Working with business and technology stakeholders to turn agreed requirements into reliable technical solutions.
Key requirements:
- Hands-on Azure Databricks experience in a production environment
- Experience developing and maintaining Databricks pipelines, data models and curated datasets
- Strong ETL/ELT and data integration experience
- Experience integrating ERP systems, SQL databases and operational platforms
- Knowledge of data modelling, data warehousing, dimensional modelling and star schemas
- Strong SQL capability
- Experience developing semantic-ready datasets for Power BI or similar BI tools
- The ability to work independently while following established technical direction
- Strong attention to data quality, documentation and delivery
- Experience in multi-business, multi-entity or multi-region environments would be advantageous.