Data Engineer

Salary: Flexible working + great team culture

The company:

Our client is a large New Zealand organisation with a strong focus on using data and technology to support better decision-making. They operate in a complex environment where data quality, security and reliability are important, and are looking for an experienced Data Engineer to support their data and analytics capability.

Why this role?

This is a hands-on Data Engineer role where you'll be responsible for building, maintaining and improving the data infrastructure that supports reporting, analytics and business operations.

You'll be working across the Microsoft Azure data stack, including Azure Synapse, Azure Data Factory and Microsoft Purview, alongside PySpark to develop and optimise data pipelines and improve how data is managed across the organisation.

Working closely with analysts, architects and technical teams, you'll help ensure data is reliable, accessible and ready to support reporting and analytics.

What you'll be doing

• Designing, developing and maintaining data pipelines using Azure Data Factory and Azure Synapse
• Building and optimising ETL/ELT processes to support data integration and transformation
• Using PySpark to process and transform data
• Working with cloud-based data warehouses, data lakes and storage solutions
• Supporting data governance and management using Microsoft Purview
• Improving data quality through validation, cleansing, reconciliation and error handling
• Monitoring and troubleshooting data pipelines to improve performance and reliability
• Identifying opportunities to automate processes and improve efficiency
• Collaborating with analysts, architects and technical teams to deliver effective data solutions

What we're looking for

We're looking for an experienced Data Engineer with strong hands-on experience across the Microsoft Azure data ecosystem.

Ideally, you'll bring:

• Solid experience designing, building and maintaining data pipelines and ETL/ELT processes
• Strong hands-on experience with Azure Data Factory and Azure Synapse
• Experience using PySpark for data processing and transformation
• Knowledge of Microsoft Purview for data governance, cataloguing and management
• Experience working with data warehouses, data lakes and cloud-based data platforms
• Strong understanding of data modelling, data integration and data quality
• Experience troubleshooting and optimising pipelines for performance and reliability
• An understanding of data security, governance and access controls
• Strong communication skills and the ability to work effectively with technical and business stakeholders
• A proactive approach to problem-solving and improving existing data processes

Experience working in large or complex data environments, particularly where data governance and security are important, would be advantageous.

Why you'll want this

You'll have the opportunity to work across a complex data environment using Azure Synapse, Azure Data Factory, Microsoft Purview and PySpark, with plenty of scope to get involved in both development and platform improvements.

There's a good mix of hands-on engineering, problem-solving and collaboration with experienced data professionals. You'll be helping improve the reliability, quality and accessibility of data used across the organisation.

If you enjoy working across the Microsoft data stack and want a role where you can take ownership of technical delivery while continuing to develop your data engineering expertise, this could be a good fit!

Apply via the link with an uptodate CV and cover letter, or reach out to Rachael Tobeck for a confidential chat.

#SCR-rachael-tobeck