Staff Data Engineer
Posted 2
views
Summary
Staff Data Engineer designing Snowflake and PySpark architecture for a bank collections platform (integration with commbank.data), modelling HPS card/account data, building data-quality and observability controls, and mentoring engineers. Core stack: Snowflake, PySpark, Python, SQL, AWS.
2. Staff Data Engineer Key responsibilities 1. Design the Collections Snowflake and PySpark architecture. 2. Lead integration with commbank.data. 3. Model HPS card and account data for Collections use cases. 4. Define data contracts and schema-evolution standards. 5. Establish automated data-quality and reconciliation controls. 6. Design restartable, idempotent and recoverable pipelines. 7. Optimise Snowflake and PySpark workloads. 8. Establish production monitoring and data-pipeline observabil…