AWS Data Engineer – Microsoft Fabric

Location: Sydney or NewCastle

Duration: Permanent

Experience: 6+ Years

Role Summary

We are seeking an experienced AWS Data Engineer with Microsoft Fabric expertise to design, build, optimize, and support enterprise-scale data platforms across AWS and Microsoft Fabric environments. The role involves developing scalable data pipelines, managing cloud-based data solutions, ensuring platform reliability, implementing governance standards, and supporting analytics and reporting initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using AWS and Microsoft Fabric.
• Build and optimize ETL/ELT processes for structured and unstructured data ingestion.
• Develop and manage data workflows using Microsoft Fabric Data Factory, Dataflows Gen2, and OneLake.
• Create and maintain data models, Lakehouses, and Data Warehouses to support reporting and analytics requirements.
• Integrate data from multiple sources including cloud, databases, APIs, and third-party systems.

AWS Data Platform Management

• Implement and support AWS data services such as S3, Glue, Lambda, Athena, Redshift, EMR, and CloudWatch.
• Monitor and optimize AWS data infrastructure performance, scalability, and cost efficiency.
• Ensure secure data transfer, storage, and access management across AWS environments.

Microsoft Fabric Administration & Support

• Support Microsoft Fabric workspaces, pipelines, Lakehouses, Warehouses, and Power BI environments.
• Troubleshoot and resolve Fabric-related production issues, pipeline failures, and data quality concerns.
• Monitor Fabric capacity utilization and recommend performance improvements.
• Support production and non-production environments, ensuring platform stability and operational excellence.

Data Governance & Security

• Implement governance standards using Microsoft Purview.
• Ensure compliance with enterprise security, privacy, and regulatory requirements.
• Maintain role-based access controls, audit logging, and data protection policies.
• Support data cataloging, lineage, and metadata management initiatives.

Operational Support

• Participate in incident, problem, and change management activities.
• Perform root cause analysis and implement preventive solutions.
• Monitor SLA compliance and support service improvement initiatives.
• Maintain operational documentation, runbooks, and technical standards.
• Work closely with Data Architects, BI Developers, Data Scientists, and Business Stakeholders.
• Support reporting and analytics initiatives through reliable data delivery.
• Contribute to cloud migration, modernization, and data platform transformation programs.
• Strong SQL development and performance tuning skills.
• Experience with ETL/ELT frameworks and big data processing.
• Knowledge of data modeling, data warehousing, and analytics platforms.
• Experience working with structured and semi-structured data.

Governance & Monitoring

• Microsoft Purview experience preferred.
• Understanding of data governance, metadata management, and compliance frameworks.
• Monitoring and troubleshooting experience across cloud data platforms.

Preferred Qualifications

• 5+ years of Data Engineering experience.
• 2+ years of Microsoft Fabric experience.
• AWS Certified Data Engineer, AWS Solutions Architect, or Microsoft Fabric/Azure certifications preferred.
• Experience working in enterprise Data & Analytics environments.
• Knowledge of DevOps, CI/CD, Infrastructure as Code (Terraform/CloudFormation), and Agile delivery methodologies.