Data Engineer- NV1 Security Clearance
Summary
Contract data engineer role requiring NV1 security clearance, building and debugging ETL pipelines on Cloudera Data Platform using Spark, Airflow, NiFi, Hive, Impala and Iceberg, with Ranger/Atlas security tied to EntraID. Work is placed at government/Defence clients in Melbourne, Canberra or Brisbane.
XPT Software Australia Pty Ltd | Contract
Data Engineer- NV1 Security Clearance
Melbourne, Canberra, Brisbane, Australia
- XPT SoftwareAustralia PTY Ltd, incorporated in 2016, is a Software Services company
- XPT works with topclients across Australia in Banking, Insurance, Telecom,Retail, Energy, Mining and Manufacturingdomains.
- We have 120+technocrats in Australia working at our clientlocations.
- XPT SoftwareAustralia is part of group companies which has globalpresence across India & Europe.
- We have served100+ clients globally, fulfilling their onsite-offshoreneeds.
Job Description
Security clearance: Candidates must hold NV1 clearance
ETL pipeline development in Spark / Cloudera Data Engineering / Airflow (critical requirement)
ETL pipeline development using NiFi within Cloudera Data Platform (strong requirement)
ETL development using DDLs and Erwin (Strong requirement)
ETL development experience using Ozone & Iceberg, Hive, Hue and Impala (critical requirement)
Configuration and management of Cloudera Data Platform environments and tenancies, including complex ranger and atlas security & access controls, linked to enterprise identity management services, such as EntraID
Complex ETL pipeline debugging and design of various methods of ETL, including truncate & reload etc (critical requirement)
Developer / Engineering skills in Cloudera Data Visualisation (nice to have)
Developer / Engineering / Integration skills in MSSQL & PowerBI (nice to have)
Excellent problem solving, communication and task management skills (strong requirement)
Previous experience working on large agency data warehouses and data integration projects (strong requirement)
Pervious experience working in Defence (desirable)