Data Engineer
Summary
Pearl Recruitment Group is hiring a Data Engineer for a major Defence program in Western Australia, based in Perth. The role establishes the foundation of an enterprise data platform on Microsoft Azure, designing a Medallion Lakehouse architecture and building automated data pipelines integrating engineering, supply-chain and corporate data.
Pearl Recruitment Group is currently recruiting for a Data Engineer to join a major Defence program in Western Australia.
This is an opportunity to help establish the foundational architecture for an enterprise data platform, integrating complex engineering, supply-chain and corporate data within a Microsoft Azure environment.
Key responsibilities will include:
- Designing and maintaining a scalable Medallion Lakehouse architecture
- Building automated data pipelines using Azure Databricks
- Developing enterprise data cataloguing, modelling and governance capabilities
- Integrating data across engineering, ERP, PLM and digital shipyard systems
- Establishing data lineage, security and access controls for Defence compliance
- Monitoring and optimising Databricks performance and cost efficiency
- Strong PySpark or Spark SQL experience within Azure Databricks
- Experience across ETL/ELT, data integration and data-quality practices
- Exposure to enterprise data catalogues such as Unity Catalog, Microsoft Purview or Collibra
- Experience designing complex enterprise data models
- Strong stakeholder engagement and problem-solving skills
- Eligibility to obtain and maintain a Baseline Clearance
- $100 - $110 per hour + super.
- Initial three-month contract with the possibility of ongoing work
- Opportunity to contribute to a significant, long-term Australian Defence program
- Technically challenging work across Azure, Databricks and complex enterprise data
- Exposure to advanced engineering and digital shipyard environments
- The chance to help shape a foundational data platform from an early stage
- Ability for a hybrid role or even to work remote for the right candidate.