Senior Data Engineer
Summary
Senior data engineer implementing large-volume ingestion, CDC/incremental loads, and Bronze-to-Silver transformation pipelines into Microsoft Fabric Lakehouse environments — configuring Fivetran connectors, optimizing performance/storage, and supporting Dev/Test/Prod promotion. Core stack: Microsoft Fabric, Fivetran, Python, PySpark, SQL.
Role & responsibilities
Role Overview
Implement ingestion, transformation, and optimization of enterprise data sources into Microsoft Fabric Lakehouse environments.
Key Responsibilities
Configure and optimize Fivetran connectors (Oracle, SQL DB, etc.)
Manage large-volume ingestion and backfill operations
Implement Bronze to Silver transformation pipelines
Develop incremental load and CDC logic
Optimize Lakehouse performance and storage patterns
Implement monitoring (record counts, load duration, failure tracking)
Support Dev/Test/Prod promotion processes
Preferred candidate profile
7+ years of data engineering experience
Hands-on experience with Microsoft Fabric (Mandatory 1+ years) or Azure Synapse/Data Factory
Strong experience with Fivetran or similar ELT tools
Proficiency in Python, PySpark, and SQL
Experience handling high-volume datasets (hundreds of millions of records)
Strong understanding of Medallion architecture and data modeling concepts.