The HR Ally
Open positions
Microsoft Fabric & PySpark Data Engineer
Contract data engineer role in Melbourne focused on designing, building and optimising data pipelines in Microsoft Fabric, writing PySpark/Python for large-scale processing, and working with Data Lake/Lakehouse architectures, ETL/ELT workflows and AI-assisted coding tools like GitHub Copilot.
Data Engineer: Microsoft Fabric & PySpark Specialist
Contract data engineer role in Melbourne focused on designing and building scalable data pipelines using Microsoft Fabric and PySpark on data lake/lakehouse architectures. Involves ETL/ELT workflow development and data validation, with Azure Data Factory, Azure Databricks and Spark skills preferred.
Microsoft Fabric & PySpark Data Engineer
Location: Melbourne Employment Type: Contract About the Role We are seeking an experienced Data Engineer with strong hands-on expertise in Microsoft Fabric, PySpark and Data Lake solutions. The ideal candidate should…
Data Engineer: Microsoft Fabric & PySpark Specialist
The HR Ally is seeking an experienced Data Engineer for a contract role in Melbourne. The position focuses on Microsoft Fabric, PySpark and Data Lake/Lakehouse architectures to design, develop and implement scalable…
Senior Azure Data Engineer – Databricks -Sydney Only
Senior/lead data engineering role based onsite in Sydney (The Rocks), for a candidate with ~8 years of experience. Day to day involves designing complex data pipelines, ETL frameworks and distributed data processing solutions on Azure using Databricks, PySpark, Python, SQL and Apache Spark.
Senior Azure Data Engineer | Databricks & PySpark Lead
The Hr Ally is hiring a Senior Azure Data Engineer/Lead in Sydney to design, build and optimize large-scale data pipelines using PySpark, Databricks, Azure Synapse and ADF, collaborating Agile-style with cross-functional teams. The role needs 8+ years of software/data engineering, strong Python and SQL, data warehousing expertise and CI/CD/MLOps familiarity.
Senior Azure Data Engineer – Databricks -Sydney Only
Senior data engineering role in Sydney (8+ yrs) focused on designing large-scale data pipelines, ETL frameworks and distributed processing on Azure. Core stack: Databricks, PySpark, Python, SQL, Azure Synapse/Data Factory/Functions, ADLS Gen2, with CI/CD via Azure DevOps; Java and Informatica are pluses.
Senior Data Engineer – Real-Time Pipelines on AWS
Senior data engineer (9-14 yrs) in Sydney building enterprise-scale data platforms on AWS: designing batch and real-time ingestion, optimizing pipelines, and delivering low-latency streaming with Kinesis/Kafka. Core stack: AWS, Python, PySpark, databases, CI/CD and IaC.
Data Engineer-Nsw
Senior data engineer (9-14 years) building enterprise-scale batch and real-time data platforms on AWS in Sydney — designing ingestion frameworks, streaming pipelines with Kinesis/Kafka, and orchestrated transformations using Python, PySpark, Airflow, Redshift and SageMaker Unified Studio.
Data Engineer MS Fabrics
Sydney-based data engineer role building end-to-end pipelines in Microsoft Fabric (Data Factory, Lakehouse/OneLake, Warehouse) using PySpark, SQL/T-SQL, with Power BI semantic models, Purview governance, and Azure DevOps/Git CI/CD.
Data Engineer: Fabric Lakehouse & Pipelines
Senior Data Engineer in Sydney building and maintaining end-to-end data pipelines on Microsoft Fabric, including Lakehouse architectures and ETL/ELT with PySpark and SQL. Also owns data quality and governance via Purview, RBAC, and sensitivity labels while collaborating with analysts and stakeholders.
Data Engineer: Fabric Lakehouse & Pipelines
The HR Ally is seeking a Senior Data Engineer in Sydney to design and maintain end-to-end data pipelines using Microsoft Fabric. You will build Lakehouse architectures, ingest data from diverse sources, and implement…