Data Engineer
Summary
Profectus is hiring Data Engineers to build data integration services and pipelines and migrate data assets to an enterprise data platform for an Australian Government agency in Canberra. Work spans SQL/Python pipeline development, data modelling, data quality remediation, and supporting data behind an Angular web app; onsite, and requires Australian citizenship with an AGSVA NV2 clearance.
Profectus is seeking multiple experienced Data Engineers to build data integration services and migrate data assets to an enterprise data platform within an Australian Government agency. The data supports a secure Angular web application that aggregates data from multiple authoritative sources. The work covers data integration, pipeline development, data migration, data quality remediation and data modelling.
Key Responsibilities
- Design and implement data integration services
- Build and maintain data pipelines
- Migrate data assets to target enterprise data platforms
- Manage data quality and remediate data issues
- Undertake data modelling, transformation and optimisation
- Work with developers to manage the impact of data changes on the web application
- Document pipelines, data models and migration activities
- Transfer knowledge to government staff
Required Experience
- Experience as a Data Engineer designing and building data pipelines
- Experience migrating data between platforms
- Strong SQL and data modelling experience
- Experience with data quality management and remediation
- Experience with Python or a similar language for data engineering
- Experience supporting data used by Angular-based web applications
- Experience working within Defence or another Australian Government agency
Desirable Experience
- Experience with the Defence One Defence Data platform
- Experience with enterprise data platforms such as Cloudera, including Apache Spark
- Experience working within the Defence Secret environment or other classified environments
- Experience applying data governance and data management practices
Security Clearance Requirements
- Must be an Australian Citizen
- Must have a current AGSVA NV2 Security Clearance (minimum)
Working Arrangements
- Onsite
- Canberra
Why Profectus
Profectus partners with Australian Government agencies to deliver trusted ICT capability across complex delivery programs. We take a long term, relationship driven approach, supporting our people across the full lifecycle of their engagement while contributing to outcomes of national importance.