Data Engineer
Working closely with the Head of Data and Senior Data Engineer, you'll be responsible for the hands-on development, testing and maintenance of secure and scalable solutions using Azure Databricks.
The environment spans multiple businesses, ERP platforms and operational systems, providing plenty of technical complexity and variety.
Key responsibilities:
- Building, testing and maintaining ETL and ELT pipelines in Azure Databricks
- Integrating data from ERP platforms, SQL databases and other operational systems
- Supporting source-to-target mappings, transformation logic and business rules
- Developing curated data models and datasets for reporting, dashboards and analytics
- Building efficient backend datasets for Power BI
- Implementing data security and access controls including RLS, security groups and access policies
- Supporting data governance, quality, privacy and documentation standards
- Automating manual data aggregation and reporting processes, including Excel-dependent financial and month-end activities
- Working with business and technology stakeholders to turn agreed requirements into reliable technical solutions.
- Hands-on Azure Databricks experience in a production environment
- Experience developing and maintaining Databricks pipelines, data models and curated datasets
- Strong ETL/ELT and data integration experience
- Experience integrating ERP systems, SQL databases and operational platforms
- Knowledge of data modelling, data warehousing, dimensional modelling and star schemas
- Strong SQL capability
- Experience developing semantic-ready datasets for Power BI or similar BI tools
- The ability to work independently while following established technical direction
- Strong attention to data quality, documentation and delivery
- Experience in multi-business, multi-entity or multi-region environments would be advantageous.