Senior Data Engineer: Spark/PySpark on Azure Lakehouses
Summary
Designs and builds Spark/PySpark pipelines on Azure Lakehouses to ingest, transform, and store investment data for analytics and downstream systems.
Areti Professional is seeking a Senior Data Engineer to shape Spark architecture, PySpark and SQL solutions on a 6-month contract in Australia. You will contribute to the enterprise data platform and build scalable data pipelines.
You will design lakehouses for investment data, implement a modern tech stack, and collaborate with cross-functional teams to deliver robust analytics and data storage for downstream systems.