Data Scientist
Posted Updated
Description
The Recruitment Hive is seeking a Data Scientist for a large Federal Government organisation to advance production-grade data solutions using R, Spark, and Databricks in an Australian context. You will analyse complex models, implement tests, and collaborate with cross-disciplinary teams to ensure robust, scalable outcomes.
The role focuses on refactoring microsimulation models, optimising performance, maintaining data pipelines with Azure Databricks and Delta Lake, and applying software
Conduct code analysis and peer review of a microsimulation model, refactoring, optimisation, and ensuring code readiness for operational use. Optimise compute usage and improve performance across Spark jobs and model workloads. Maintain scalable data pipelines and workflows using Azure Databricks, Delta Lake, and related services. Implement best practice data engineering standards, including version control, testing frameworks, logging, monitoring, and error handling processes. Collaborate closely with other data scientists, analysts, engineers and domain experts to understand model structure and ensure accurate, performant implementation. Experience delivering complex models into production. Designing and implementing scenario testing methodologies. Optimising computational performance and scalability for large-scale data processing. Solid understanding of software engineering practices, including automated testing, modular code design, and version control.Skills
Sign in to read and join the discussion.