Senior Data Engineer - PySpark & Cloud ETL for SaaS
Summary
Senior data engineer building and maintaining scalable PySpark ETL/ELT pipelines across Azure and AWS for a SaaS platform. Day to day: developing in-house PySpark frameworks, embedding data services into the product architecture, and ensuring data quality, security, and observability. Remote-first, based in Sydney with some travel to client sites across Australia.
Halo Labs is seeking a Data Engineer with PySpark expertise to design and maintain scalable data pipelines across Azure and AWS in our SaaS platform. You will build in-house PySpark frameworks, implement ETL/ELT pipelines, and collaborate with software engineers to embed data services into the product architecture, while ensuring data quality, security, and observability.
We offer a remote-first work environment with opportunity for travel to client locations across Australia, a learning budget,