Senior Real-Time Data Engineer: Python & Spark Pipelines
Summary
Build and optimize real-time data pipelines using Python and Apache Spark to support trading research and large-scale data processing for a quantitative trading firm.
Optiver Private Jobs in Australia invites a seasoned Senior Data Engineer to elevate our research data capabilities. You will collaborate with local researchers and the Global Research and Data Platform teams to implement workflows, improve large-scale data processing, and manage infrastructure costs.
The role requires strong Python and Apache Spark skills, solid data modeling and ETL experience, and cloud experience (AWS or Azure).