Senior Data Engineer - AI Platform & Architecture

Salary: Up to $225,000 PKG

BLACKROC is recruiting on behalf of one of Australia’s most forward-thinking AI-first organisations.

Our client operates with zero legacy technology; everything yes, everything is built from the ground up using the latest modern data and AI engineering practices. Data is the foundation that powers their AI strategy, used intelligently both internally and externally to build a real competitive moat for the future.

They believe AI is a powerful tool that should enhance human potential, not replace it. People, culture and values remain at the centre of the organisation; this is a philosophy strongly supported from the Board and CEO through to the CIO. They recently achieved 98% adoption on a major AI rollout across their 500-person company.

We’re looking for an experienced Senior Data Engineer, AI Platform & Lakehouse Architecture to play a key role in designing and evolving their new Databricks Lakehouse platform.

You will take ownership of the platform architecture, focusing on:

• Designing and evolving the Databricks Lakehouse architecture
• Defining Medallion layer structures, table formats, partitioning, clustering and data lifecycle policies
• Implementing Unity Catalogue, governance, access controls, and schema evolution practices
• Optimising compute strategy, cost efficiency, performance and scalability
• Establishing engineering standards, best practices and technical leadership across the team

You’ll work in a collaborative, high-performing environment with a "Silicon Valley" mindset, clean architecture, high standards, rapid iteration and real ownership.

What You’ll Bring

• 7+ years’ experience building and architecting modern data platforms
• Deep hands-on expertise with Databricks, Delta Lake, Lakehouse architecture, and Unity Catalogue
• Strong skills in data modelling, governance, observability, and platform reliability
• Proficiency in Python, SQL and PySpark
• Experience supporting large-scale AI/ML workloads (a big plus)
• A collaborative, mentoring mindset and excellent communication skills
• Full Australian work rights

Why Join

• Work on greenfield AI data infrastructure with zero legacy constraints
• Have real impact on strategic platform decisions in an AI-first organisation
• Competitive salary + salary packaging
• Modern Bowen Hills office with good transport links
• Strong executive sponsorship for data and AI initiatives

We strongly encourage applications from women and people from diverse backgrounds; our client is genuinely committed to building a more inclusive tech team.

If you’re a Senior Data Engineer who loves platform architecture and wants to work on cutting-edge AI data systems in a company that values both innovation and its people, we’d love to hear from you.

For more information, please contact; [email protected] or [email protected]

At BLACKROC Recruitment, we are committed to fostering diversity, equity, and inclusion.
We welcome applications from individuals of diverse backgrounds, including those with lived experiences.

If you require any adjustments during the recruitment process, please don’t hesitate to reach out to the above-mentioned BLACKROC Consultant.