Data Engineer - Contract | Canberra | Baseline Clearance
Summary
The Data Engineer will design and build batch and real-time data pipelines using Scala and Python to support identity resolution and attribution frameworks. This role is part of a data platform modernization project and requires a Baseline security clearance.
Data Engineer | Contract 12mths| Canberra | Baseline Clearance
About the opportunity
A leading global technology and IT services provider is kicking off a new project in Canberra and is looking for an experienced Data Engineer to join the build. You'll be working on identity resolution and attribution capabilities that form part of a broader data platform modernisation effort.
The role
- Design, build, and optimise batch and real-time data pipelines using Scala and Python
- Develop and maintain identity resolution and attribution frameworks across disparate data sources
- Build and support baseline (entity resolution / master data) processes, ensuring data consistency and quality
- Partner with data analysts, data scientists, and stakeholders to translate requirements into engineered pipelines
- Contribute to the evolution of the broader data architecture
What you'll bring
- Strong hands-on Scala and Python
- Demonstrated experience building both batch and real-time/streaming pipelines
- Identity resolution and attribution experience across multiple data sources
- Baseline/master data management experience (data quality, deduplication, reconciliation)
- Minimum Baseline security clearance
Quantexa platform experience is highly regarded and will be prioritised, along with cloud platform exposure (GCP/BigQuery, AWS, or Azure) and experience in a regulated industry.