Data Analyst and Engineers
Summary
Senior Data Engineers working with a Federal Government client in Canberra, migrating SAS code, workflows and reporting to Databricks while preserving business logic and data quality. Day to day involves building ETL/ELT pipelines with PySpark, Spark SQL and Delta Lake, plus CI/CD via Azure DevOps, Git, and data governance.
Job Description
Job Overview
Our Federal Government client is seeking experienced Senior Data Engineers with strong expertise in modern data engineering and cloud-based data platforms.
The successful candidates will have demonstrated experience in migrating SAS code, workflows, and reporting processes to Databricks, while preserving existing business logic and ensuring data integrity, accuracy, and quality throughout the migration process.
Job Requirement- Demonstrated experience designing and delivering scalable Databricks data solutions using PySpark, Spark SQL, SQL and Delta Lake.
- Demonstrated experience migrating SAS code, workflows and reporting processes to Databricks while preserving business logic and data quality.
- Experience building maintainable ETL/ELT pipelines and data models, including automated validation, monitoring and performance optimisation.
- Proven capability with Azure DevOps, Git, CI/CD, source control and controlled deployment practices.
- Ability to apply security, privacy, metadata and data governance controls and produce clear technical documentation.
Canberra
Due to the nature of this role, this job is open to Australian Citizens only. Candidates who currently hold or able to obtain Federal Government Security Clearances are highly desirable.
Calleo is an equal opportunity employer, and we encourage applications from all people including Aboriginal and Torres Strait Islander people.
#J-18808-Ljbffr