Senior Data Engineer - Fabric, Azure, Power BI
Summary
Designs and builds data pipelines to migrate financial data into Microsoft Fabric, transforming structured/unstructured data for Power BI dashboards and self-service analytics. Core tools: Fabric Lakehouse, SQL, PySpark, and Power BI.
Salary: $850pd + super
Senior Data Engineer required to build data pipelines to ingest data from source systems as part of a migration to MS Fabric for a leading financial services business.Responsibilities:
- partner with IT and non-technical stakeholders to understand and define requirements
- build, test and implement data pipelines
- gather and transform structured and unstructured data from various systems, presenting it in an easy-to-use way for its relevant audience
- build insightful and visually appealing Power BI dashboards
- refine processes, and develop and troubleshoot queries
- extensive experience working in an on-prem and Cloud data warehousing environment
- solid experience working with MS Fabric including Lake house and OneLake
- expertise developing SQL scripts and stored procedures
- strong Pyspark coding skills
- experience using CoPilot to improve self-service analytics for Power BI report users