Data Engineer: Fabric & Azure Data Pipelines
Posted Updated
Description
Core-Asset Consulting Ltd is seeking a data engineer to design, build and optimize data pipelines using Microsoft Fabric. You will collaborate with business stakeholders to translate requirements into scalable data solutions and ensure reliability and performance.
The role emphasizes strong T-SQL, Spark/PySpark, and Azure expertise, with opportunities to migrate legacy reporting and work in a dynamic, improvement-focused environment.
Translate complex transactional data into optimized analytical models (facts and dimensions). Design, build and enhance data pipelines within Microsoft Fabric for performance and quality. Engineer integrations from various data sources using ETL/ELT methods. Monitor and optimize SQL-based workflows for daily data processing. Lead migration of legacy datasets to modern platforms with minimal disruption. Collaborate with analytics teams to develop data models and engineered datasets. Partner with data science to create summaries and aggregates for analytics and modelling, and respond to ad hoc data requests. Proficient in T-SQL and writing complex queries. Strong Spark and PySpark experience for scalable processing. Solid understanding of OLTP/OLAP and data modelling. Experience with Azure services including Fabric, Data Factory, Data Lake and Data Warehouse. Knowledge of ETL/ELT best practices. Analytical mindset focused on data accuracy and reliability. Excellent collaboration and communication with stakeholders. Adaptable to dynamic environments and continuous improvement. A highly competitive salary Wider Benefits packageSkills
Sign in to read and join the discussion.