Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

The HR Ally

NewBe an early applicant

Microsoft Fabric & PySpark Data Engineer

Posted 29 views

Summary

Contract data engineer role in Melbourne focused on designing, building and optimising data pipelines in Microsoft Fabric, writing PySpark/Python for large-scale processing, and working with Data Lake/Lakehouse architectures, ETL/ELT workflows and AI-assisted coding tools like GitHub Copilot.

Microsoft Fabric & PySpark Data Engineer

Location: Melbourne
Employment Type: Contract

About the Role

We are seeking an experienced Data Engineer with strong hands‑on expertise in Microsoft Fabric, PySpark and Data Lake solutions. The ideal candidate should have deep technical knowledge and practical experience in designing, developing and implementing scalable data engineering solutions.

Key Responsibilities

  • Design, develop and maintain data pipelines using Microsoft Fabric.
  • Build and optimise ETL/ELT workflows and data integration solutions.
  • Develop PySpark scripts for large-scale data processing and transformation.
  • Work with Data Lake, Lakehouse architecture and related data engineering components.
  • Perform data transformation, cleansing, validation and optimisation.
  • Troubleshoot performance issues and ensure data quality and reliability.
  • Leverage AI-assisted coding tools to improve development efficiency and productivity.

Required Skills

  • Strong hands‑on experience with Microsoft Fabric.
  • Excellent programming skills in PySpark and Python.
  • Solid understanding of Data Lake and Lakehouse architectures.
  • Experience developing and optimising data pipelines and ETL/ELT processes.
  • Strong technical understanding of data engineering concepts and architecture.
  • Practical knowledge of AI-assisted development tools such as GitHub Copilot or similar.
  • Ability to independently design, develop and troubleshoot technical solutions.

Preferred Skills

  • Experience with Azure Data Factory, Azure Databricks and Spark.
  • Knowledge of data modelling and performance optimisation.
  • Experience working in Agile development environments.

Skills

Apply

See also

Data Engineering jobs by country — openings, pay and top skills →