Senior Data Engineer
Summary
Senior Data Engineer builds and operates Azure/Databricks pipelines that integrate fleet telemetry, maintenance systems, and predictive analytics to optimize heavy-equipment operations.
About the Role
Stellar Recruitment is partnering with this leading mining equipment rental, maintenance, and rebuild services organisation.
Reporting to the GM Operational Technology & Business Improvement, this is a senior hands-on role responsible for building and operating the data platform connecting fleet telemetry, condition monitoring, maintenance and enterprise systems.
You will work across the OT/IT environment, using Azure and Databricks to develop reliable data pipelines and models that support fleet optimisation, predictive maintenance, analytics and machine learning.
Key Responsibilities
- Design, build and operate batch and streaming data pipelines across telemetry, condition monitoring, CMMS and ERP systems
- Develop the correlation layer connecting alarms, work orders, assets and signal data
- Build dimensional and time-series data models across complex industrial data sources
- Coordinate workloads through Databricks Workflows and Jobs
- Establish DataOps practices including CI/CD, automated testing, monitoring and environment promotion
- Manage data governance, lineage and access through Unity Catalog
- Build reliable data foundations supporting anomaly detection and predictive maintenance initiatives
- Optimise Azure and Databricks environments for performance, reliability and cost
- Work closely with IT and operational teams around OT/IT security and data integration
About You
- Heavy industry or Operational Technology experience is essential for this position.
- You will be an experienced Data Engineer who remains highly hands-on and can demonstrate production data pipelines you have personally designed, coded and operated.
Requirements
- Data engineering experience within mining, oil and gas, heavy industry or an OT environment
- Strong Python and SQL skills
- Production experience across batch and streaming data pipelines
- Strong Azure data platform experience
- Hands-on Databricks experience including Spark, Delta, Workflows, Jobs and Unity Catalog
- Strong DataOps experience including CI/CD, git, automated testing and pipeline monitoring
- Experience with time-series, telemetry, historian or SCADA data
- Understanding of OT/IT environments, segmentation and security requirements
Highly Regarded
- Predictive or prescriptive maintenance experience
- Mining or heavy mobile equipment telemetry and equipment data.
- Feature and label pipelines supporting machine-learning workloads
- Edge gateways and industrial connectivity
- Terraform or Bicep