Mid / Senior Data Engineer Or Analyst (Citizens With Baseline)
Posted
Description
Purpose: provide data engineering and analysis skills to data heavy deliverables.
Seniority: Mid to senior.
Reports to: Data Architect.
Responsibilities
- Build version controlled pipelines for profiling, cleansing, transformation and migration.
- Automate reconciliation between legacy and target (counts, control totals, field comparisons).
- Provide masked test data for non production environments.
- Document pipelines and pair with ASIC data staff.
Essential: data engineering on a modern platform; SQL and Python or Spark; data quality and reconciliation.
Desirable: Databricks; mainframe or Informix data extraction; registry or financial data.
Requirements
- Build version controlled pipelines for profiling, cleansing, transformation and migration.
- Automate reconciliation between legacy and target (counts, control totals, field comparisons).
- Provide masked test data for non production environments.
- Document pipelines and pair with ASIC data staff.
Mid / Senior Data Engineer or Analyst (Citizens with Baseline) Traralgon, NSW, au
Skills
Sign in to read and join the discussion.