Data Engineer - Fabric

Duration: Initial contract to 29 October 2027 + possible 6-month extension
Location: Brisbane CBD
Work Arrangements: Flexible WFH

Company Overview

BLACKROC is partnering with a Queensland Government department to recruit a Senior Data Engineer for a major transformation program now in its build stage. The program is delivering a new customer portal, CRM, modern data platform and integration platform.

Role Purpose

You’ll design, build, test and support scalable data pipelines, medallion-layer structures and reusable data products in Microsoft Fabric. Data will come from Dynamics 365, Dataverse, Power Platform and Azure. You’ll work independently in an Agile team and test patterns early through prototypes and spikes. You’ll partner with Data Architects, Senior Data Analysts, Solution Architects, developers and testers so the data is trusted, secure and ready for reporting, analytics, migration and operational use.

Key Responsibilities

• Design, build and support Fabric pipelines, lakehouses, warehouses, dataflows, notebooks and reusable data products
• Move data through raw, transformed and curated medallion layers, each with a clear purpose and quality standard
• Ingest and curate data from Dynamics 365, Dataverse, Azure, legacy and external systems, including through Fabric Link for Dataverse
• Build validation, reconciliation, error handling, logging, monitoring and alerting into every pipeline
• Investigate data quality issues and drive practical fixes with analysts, architects and the business
• Use spikes and proof-of-concepts to test data patterns, performance and Fabric Link behaviour before full build
• Support Power BI, semantic models and curated datasets with the Senior Data Analysts
• Help with testing, defect triage, migration cycles, release readiness and operational handover

Required Skills & Experience

• Extensive data engineering experience in large or complex enterprise environments
• Strong hands-on Microsoft Fabric experience: lakehouses, warehouses, OneLake, pipelines, notebooks, dataflows, SQL analytics endpoints and workspace delivery patterns
• Strong experience building ETL/ELT pipelines, transformations, curated datasets and reusable data products
• Experience with medallion or similar layered data architecture
• Experience ingesting data from Dynamics 365, Dataverse, Power Platform or comparable enterprise systems
• Experience with Fabric Link for Dataverse, Azure Synapse Link or similar Dataverse-to-analytics patterns
• Strong SQL skills across structured and semi-structured data
• Experience with data validation, reconciliation, error handling, monitoring and operational support
• Experience supporting semantic models, data marts and Power BI consumption
• Azure DevOps (or equivalent) for source control, CI/CD and release support
• Strong understanding of data quality, lineage, security, privacy, role-based access and governance
• Experience in Agile teams covering backlog refinement, estimation, sprint planning and release readiness

Preferred Skills & Qualifications

• PySpark, Python, T-SQL, Power Query, Dataflow Gen2, Fabric deployment pipelines and Fabric Git integration
• Direct Lake, domain-aligned data products or data mesh patterns
• Azure Data Lake, Azure SQL, Functions, Logic Apps, Service Bus, Event Grid, API Management, Key Vault and managed identities
• Power BI semantic models, DAX awareness, row-level and object-level security, sensitivity labels
• Data migration, mock loads, cutover validation and legacy system replacement programs
• Data governance, metadata management, cataloguing, MDM and data quality frameworks
• Infrastructure as code (Bicep or Terraform)
• Microsoft Fabric, Azure Data Engineer, Power BI, Dynamics 365, Power Platform or Azure certifications

At BLACKROC Recruitment, we are committed to fostering diversity, equity, and inclusion. We welcome applications from individuals of diverse backgrounds, including those with lived experiences. If you require any adjustments during the recruitment process, please don’t hesitate to reach out to the above-mentioned BLACKROC Consultant.