Mid / Senior Data Engineer or Analyst (Citizens with Baseline)
Summary
Mid/senior data engineer or analyst supporting ASIC data-migration deliverables in Melbourne: building version-controlled pipelines for profiling, cleansing, transformation and migration, and automating reconciliation between legacy and target systems. Core stack is SQL plus Python or Spark; Australian citizens with Baseline clearance required.
Purpose: provide data engineering and analysis skills to data heavy deliverables.
Seniority: Mid to senior.
Reports to: Data Architect.
Responsibilities
- Build version controlled pipelines for profiling, cleansing, transformation and migration.
- Automate reconciliation between legacy and target (counts, control totals, field comparisons).
- Provide masked test data for non production environments.
- Document pipelines and pair with ASIC data staff.
Essential: data engineering on a modern platform; SQL and Python or Spark; data quality and reconciliation.
Desirable: Databricks; mainframe or Informix data extraction; registry or financial data.
Skills
Sign in to read and join the discussion.