Senior Data Engineer - Databricks

We are seeking a Senior Data Engineer with deep Databricks expertise to design, build, and optimise enterprise-scale data platforms and pipelines. This role combines hands-on engineering, solution architecture, and technical leadership, with a strong focus on mentoring internal team members and driving engineering best practices.

Client Details

Our client is a large, well established organisation operating complex, data-intensive industrial environments across Australia. They are investing heavily in modern data platforms and cloud technologies to improve operational insights, scalability, and data-driven decision making.

Description

• Design and develop scalable ETL/ELT pipelines using Databricks and Spark.
• Build and maintain enterprise-grade data platform solutions.
• Architect data migration, integration, and transformation strategies.
• Develop data ingestion frameworks from databases, APIs, and streaming sources.
• Transform complex and semi-structured datasets into curated data products.
• Implement orchestration, monitoring, and automated deployment processes.
• Establish engineering standards, governance frameworks, and best practices.
• Mentor and coach internal data engineers to improve technical capability.

Profile

• Extensive experience as a Senior Data Engineer.
• Strong expertise with Databricks, Apache Spark, and Delta Lake.
• Advanced SQL and Python development skills.
• Experience designing modern cloud-based data platforms.
• Proven capability building enterprise ETL/ELT solutions.
• Strong understanding of CI/CD, automation, and platform governance.
• Experience with orchestration tools such as Airflow and dbt.
• Excellent communication and mentoring skills.

Job Offer

• Opportunity to shape a large-scale cloud data platform.
• Technical leadership and mentoring responsibilities.
• Exposure to complex enterprise data environments.
• Collaborative and highly skilled technology team.
• Significant influence over engineering standards and platform direction.

This is an opportunity to join a business undergoing a major data transformation, where you'll play a critical role in both delivering technical outcomes and developing internal engineering capability.

To apply online please click the 'Apply' button below. For a confidential discussion about this role please contact Mitchell Anderson on mitchellanderson@michaelpage.com.au