Senior Data Engineer
ABOUT THE ROLE
We are looking for a Senior Data Engineer with strong Microsoft Fabric expertise to join a fast-growing data engineering team. You will be responsible for designing, building, and optimizing data solutions on the Microsoft Fabric platform — working across the full data engineering lifecycle from ingestion to serving.
The ideal candidate brings deep hands-on experience with Fabric, a strong engineering mindset, and the ability to work independently in a collaborative, delivery-focused environment.
WHAT YOU WILL DO
Design and build end-to-end data pipelines using Microsoft Fabric Data Factory
Develop and maintain Fabric Spark Notebooks for data transformation and processing
Migrate legacy data pipelines and workloads onto the Microsoft Fabric platform
Implement and manage data warehouse solutions using Fabric Warehouse and OneLake
Build and maintain Medallion architecture (Bronze / Silver / Gold) on OneLake
Design and implement SCD Type 1/2 patterns and complex transformation logic in PySpark and T-SQL
Develop and maintain CI/CD workflows using Fabric Deployment Pipelines and Azure DevOps
Collaborate with architects and business stakeholders to translate requirements into scalable data solutions
Ensure data quality through reconciliation, testing, and validation across environments
Support UAT, parallel run activities, and production cutover cycle
REQUIRED SKILLS
• Microsoft Fabric — Fabric Data Factory, Spark Notebooks, Fabric Warehouse, OneLake, Deployment Pipelines
• Azure Data Factory —pipelines, master/child patterns, Copy / Lookup / ForEach / Stored Procedure activities
• PySpark and Python — Delta Lake read/write, transformation logic, file I/O on OneLake / ADLS
• T-SQL — complex stored procedures, MERGE, SCD logic, dynamic SQL
• Medallion architecture (Bronze / Silver / Gold) implementation on Fabric or Databricks
• Databricks — notebooks, dbutils, workspace files, cluster configuration
• CI/CD with Azure DevOps and Git — branching strategy, PR-gated deployments, environment promotion
• Experience in Analysis, Design, Development, Implementation, Testing and Support of Data Warehousing and Data Integration Solutions and ETL data pipelines
• 5+ years in data engineering with at least 1 year hands-on in Microsoft Fabric
NICE TO HAVE
• Microsoft Fabric certification (DP-700 or equivalent)
• Experience migrating from Databricks or ADF to Microsoft Fabric
• Financial services or investment data domain knowledge
• Microsoft Purview — lineage, sensitivity labels, workspace scanning
• Power BI Direct Lake mode and semantic model design
• Experience in ETL design and development, Data Quality, and Data Engineering using Informatica.