Senior Python Data Engineer - Scraping & ETL (Remote)
Posted 1
view
Summary
Senior Python data engineer building scraping and ETL pipelines across Azure and AWS: optimising Spark jobs in Databricks, implementing CI/CD, and ensuring data governance, security, and production stability. Remote-first, with occasional travel to client sites across Australia.
You will work with Azure and AWS environments, optimise Spark jobs, implement CI/CD, and ensure data governance, security, and production stability while collaborating with software engineers.
This remote-first role requires strong Python, PySpark, Databricks expertise and ability to travel to client sites across Australia.