Principal Data Engineer
Summary
Principal Data Engineer for an established enterprise data team in Sydney: a 50/50 hands-on leadership role architecting scalable, secure data platforms and pipelines on AWS, mentoring engineers and driving DataOps, CI/CD and governance. Core stack includes Python, Spark, dbt, Airflow, Redshift and Iceberg, with a chance to implement SageMaker.
Principal Data Engineer & Designer
Are you ready to architect the future of data in a high-performance, mission-critical environment?
Come and join this established enterprise data team and lead and own the design and development of scalable, secure data solutions on AWS. In this 50/50 hands on role you’ll architect and optimise data pipelines, mentor engineers, and collaborate with stakeholders to deliver high-performance, future-ready data products. You'll also have an opportunity to implement SageMaker!
Key responsibilities
- Lead end-to-end data platform architecture
- Design scalable data lake and data mesh solutions
- Build reusable data engineering frameworks and tools
- Partner with stakeholders to deliver effective data solutions
- Drive DataOps, CI/CD, automation and observability
- Embed security, privacy, governance and reliability
What we’re looking for
- 10+ years’ data engineering experience.
- Strong AWS data platform and pipeline experience.
- Expertise in Python, Spark, dbt and Airflow.
- Strong knowledge of distributed systems and data architecture.
- Experience with Redshift, Iceberg and data lakehouse patterns.
- Proven experience leading data platform design and governance.
Skills
Sign in to read and join the discussion.