Data Engineer
Posted Updated 6
views
Summary
A hands-on Data Engineer in Melbourne builds and maintains ETL/ELT pipelines, data models and secure curated datasets in Azure Databricks, integrating ERP and SQL sources across multiple businesses to power Power BI reporting, plus governance and automation of manual reporting.
We're looking for an experienced Data Engineer to join a growing data team and help build a modern, scalable data environment from the ground up.
Working closely with the Head of Data and Senior Data Engineer, you'll be responsible for the hands-on development, testing and maintenance of secure and scalable solutions using Azure Databricks.
The environment spans multiple businesses, ERP platforms and operational systems, providing plenty of technical complexity and variety.
Key responsibilities:
Working closely with the Head of Data and Senior Data Engineer, you'll be responsible for the hands-on development, testing and maintenance of secure and scalable solutions using Azure Databricks.
The environment spans multiple businesses, ERP platforms and operational systems, providing plenty of technical complexity and variety.
Key responsibilities:
- Building, testing and maintaining ETL and ELT pipelines in Azure Databricks
- Integrating data from ERP platforms, SQL databases and other operational systems
- Supporting source-to-target mappings, transformation logic and business rules
- Developing curated data models and datasets for reporting, dashboards and analytics
- Building efficient backend datasets for Power BI
- Implementing data security and access controls including RLS, security groups and access policies
- Supporting data governance, quality, privacy and documentation standards
- Automating manual data aggregation and reporting processes, including Excel-dependent financial and month-end activities
- Working with business and technology stakeholders to turn agreed requirements into reliable technical solutions.
- Hands-on Azure Databricks experience in a production environment
- Experience integrating ERP systems, SQL databases and operational platforms
- Experience developing and maintaining Databricks pipelines, data models and curated datasets
- Strong ETL/ELT and data integration experience
- Knowledge of data modelling, data warehousing, dimensional modelling and star schemas
- Strong SQL capability
- Experience developing semantic-ready datasets for Power BI or similar BI tools
- The ability to work independently while following established technical direction
- Strong attention to data quality, documentation and delivery
- Experience in multi-business, multi-entity or multi-region environments would be advantageous.