Senior Data Engineer - Fabric, Azure, Power BI
Posted 7
views
Summary
Senior Data Engineer responsible for building data pipelines for a migration to MS Fabric within a financial services firm. The role involves transforming structured and unstructured data using SQL and PySpark, and creating Power BI dashboards using CoPilot for self-service analytics.
Salary: $850pd + super
Senior Data Engineer required to build data pipelines to ingest data from source systems as part of a migration to MS Fabric for a leading financial services business.Responsibilities:
- partner with IT and non-technical stakeholders to understand and define requirements
- build, test and implement data pipelines
- gather and transform structured and unstructured data from various systems, presenting it in an easy-to-use way for its relevant audience
- build insightful and visually appealing Power BI dashboards
- refine processes, and develop and troubleshoot queries
- extensive experience working in an on-prem and Cloud data warehousing environment
- solid experience working with MS Fabric including Lake house and OneLake
- expertise developing SQL scripts and stored procedures
- strong Pyspark coding skills
- experience using CoPilot to improve self-service analytics for Power BI report users