Data Engineer

Location: Melbourne
Contract: 12 month

Responsibilities

• Build and maintain scalable ETL/ELT workflows using Informatica (mappings, workflows, scheduling and monitoring)
• Manage BigQuery datasets and tables, including partitioning and clustering for large-scale analytics
• Write and optimise advanced SQL to improve performance and reduce compute cost
• Develop Python scripts for file parsing, orchestration and integration with cloud APIs
• Automate operational routines using Unix shell scripting (file transfers, pre/post-load steps, batch sequencing)
• Schedule, monitor and troubleshoot integrated batch workflows across on-prem and cloud schedulers
• Implement robust data validation, error handling and logging to improve data quality and reliability
• Diagnose and resolve bottlenecks across Informatica, BigQuery SQL and scripting components
• Maintain technical documentation (mapping specs, runbooks, diagrams) and collaborate with analysts/testing/business stakeholders

Requirements

• 4-7 years' hands-on data engineering experience building and supporting production data pipelines
• Strong Informatica experience (development, scheduling, monitoring, troubleshooting)
• Proven Google BigQuery capability (table design, dataset management, partitioning/clustering, performance optimisation)
• Advanced SQL skills (complex joins, window functions, tuning, validation routines)
• Python proficiency for data processing, automation and reusable utilities
• Strong understanding of operational monitoring, reconciliation, logging and batch workload support
• Demonstrated ability to troubleshoot end-to-end data pipeline issues across tools and scripts
• Experience producing and maintaining technical documentation and working in delivery teams

Desirables

• Unix shell scripting for orchestration/automation in data pipeline operations
• Experience supporting cloud migration or hybrid integration (moving legacy on-prem data into cloud platforms)
• Familiarity with Agile delivery, version control and release processes across distributed teams
• Relevant degree (Computer Science / IT / Data Engineering or similar) and/or cloud/data/Informatica certifications

To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Karina Gan on email kgan@paxus.com.au and quote the above job reference number.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.