Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Verse

NewBe an early applicant

Databricks Engineer

Posted

Description

About the Role

An exciting opportunity is available for an experienced Mid-Level Data Engineer to join a specialist consulting team, supporting a fast-paced, high-impact MVP data delivery project for a client in the resources sector.


The successful candidate will play a critical role in building end-to-end data ingestion and transformation pipelines within Databricks. Working with operational IoT data streams and enterprise ERP data, you'll be responsible for connecting to upstream data sources, ingesting raw datasets, and structuring them across a medallion architecture to enable a downstream production application.


Working closely with a senior Databricks consultant, upstream data specialists, third-party IoT vendors, and a senior industry sponsor, you'll contribute to rapid data pipeline development, transformation, and delivery. The role requires a capable, pragmatic data engineer who can hit the ground running, extract requirements directly from business stakeholders, and deliver clean data outputs under tight MVP timelines.


This is an initial full-time contract of approximately six weeks through to the end of December, with potential for further project work in 2027. The successful candidate will be required to hit the ground running immediately, working on-site in the Perth CBD alongside the delivery team.


You Should Have

  • 3 to 5 years of commercial experience in Data Engineering or Databricks consulting
  • Strong hands-on experience working within the Databricks ecosystem
  • Proven ability to connect to data sources and build ingestion pipelines using JDBC connectors
  • Solid experience designing and implementing Medallion Architecture (Bronze, Silver, and Gold layers)
  • Ability to work pragmatically in a fast-paced MVP environment without relying on heavy, formal data modelling frameworks
  • Experience working with IoT / operational technology data platforms and ERP systems (such as SAP)
  • Strong communication skills and the ability to extract undocumented requirements directly from business sponsors and subject matter experts
  • Ability to work collaboratively within a small, lean, multi-disciplinary project team
  • A proactive, self-starting approach with the ability to hit the ground running immediately in a high-pressure delivery environment


Technical Requirements

Must Have

  • Databricks platform development and data engineering
  • Data ingestion and source connectivity via JDBC connectors
  • Medallion architecture design and data promotion (Bronze, Silver, Gold)
  • Data cleansing, transformation, and preparation for downstream application consumption
  • Pragmatic, MVP-focused data delivery skills
  • Strong stakeholder communication and requirement-gathering capabilities


Nice to Have

  • Prior exposure to the mining or resources industry
  • Experience working with AVEVA IoT data platforms and site-specific data tagging
  • Experience ingesting and transforming SAP enterprise data
  • Experience preparing Gold-tier datasets specifically for Databricks Apps


Key Responsibilities

  • Connect to upstream data sources, including tagged AVEVA IoT feeds and SAP systems, using JDBC connectors
  • Design, build, and manage end-to-end data ingestion and transformation pipelines in Databricks
  • Ingest raw data into the Bronze layer, apply necessary transformations in Silver, and deliver structured, reliable datasets in the Gold tier
  • Collaborate closely with the upstream consultant applying site-specific tags to incoming IoT data
  • Partner with the downstream Senior Databricks Consultant to ensure Gold-tier data meets formatting and performance requirements for the final Databricks application
  • Liaise directly with the project sponsor and industry specialists to clarify and capture business requirements
  • Deliver data pipelines efficiently to meet tight, six-week MVP project milestones


Working Arrangements

  • Full-time, on-site role based in the Perth CBD
  • Monday to Friday, standard business hours
  • Close, face-to-face collaboration with the consulting and client delivery team


Contract & Benefits

  • Initial full-time contract of approximately 6 weeks, running through to the end of December
  • Potential for follow-on project work in 2027
  • Daily rate of up to $1,000 per day including super
  • Immediate start available
  • Opportunity to deliver a high-visibility MVP data solution for a major industry client
  • Work directly alongside a Senior Databricks Consultant and experienced industry specialists
  • Hands-on exposure to real-world industrial IoT (AVEVA) and SAP data integration in Databricks


How to Apply

If this opportunity resonates with you, please apply.

For further details, contact Jakson on 0468 056 015 or jakson@versegroup.com.au.

Skills

Apply

See also