Senior Data Engineer - Databricks / Azure

Join a well-known NZ organisation investing heavily in its digital and data capability. We’re looking for an experienced Senior Data Engineer to help design, build and optimise a modern cloud-based data platform, with a strong focus on Databricks, Azure and scalable data engineering.

This is a hands-on senior role suited to someone who enjoys solving complex data problems, building robust pipelines and working across both batch and real-time data environments.

What you'll be doing

• Designing and building scalable data pipelines using Databricks and Azure Data Factory
• Developing data workflows using Python, PySpark and SQL
• Building and optimising ETL/ELT pipelines across cloud and on-premise data sources
• Working with Delta Lake, CDC and lakehouse architecture
• Developing batch and real-time data processing solutions
• Working with technologies such as Spark Structured Streaming, Event Hubs and Kafka
• Optimising Spark workloads, Databricks jobs and data storage patterns
• Designing data models for analytical and operational use cases
• Improving data quality, monitoring, governance and reliability
• Supporting CI/CD, code reviews and engineering best practice
• Mentoring other engineers and contributing to technical standards

What we're looking for

• 5+ years' experience in Data Engineering
• At least 2 years' strong hands-on Databricks experience
• Strong Python, PySpark and SQL capability
• Solid experience with Azure Data Factory
• Strong understanding of Apache Spark and Delta Lake
• Experience working with Azure Data Lake and broader Azure data services
• Experience building production-grade batch and/or streaming pipelines
• Good understanding of data modelling, data warehousing and lakehouse concepts
• Experience with Git, CI/CD and modern engineering practices
• Strong troubleshooting, performance optimisation and problem-solving skills

Experience with Unity Catalog, Kafka/Event Hubs, Docker, Infrastructure as Code, MLOps or data governance would be advantageous.

This is a great opportunity for a senior engineer who wants to work on a modern data platform in a highly visible environment where data plays an important role in the organisation's digital strategy.

Apply now or get in touch with Caitlin on 0212241361 for a confidential discussion.

#SCR-kelly-cappel