Data Engineer
We are seeking an experienced and driven Data Engineer with 8+ years of hands-on expertise to design, build, and scale our next-generation data infrastructure. In this role, you will play a critical part in architecting robust data pipelines, optimizing complex transformations, and maximizing the value of our cloud data assets using modern Microsoft platforms.
Key Responsibilities
- Data Pipeline Engineering: Design, develop, maintain, and optimize scalable, reliable, and secure end-to-end data pipelines using Azure data services and Microsoft Fabric.
- Modern Data Architecture: Work extensively with core Microsoft Fabric components, including Fabric Data Factory, Lakehouse, Warehouse, and other advanced data engineering capabilities.
- Data Transformation & Optimization: Write, debug, and fine-tune complex SQL queries, stored procedures, views, and intricate data transformation logic to ensure high performance and data integrity.
- Collaboration & Scale: Partner closely with analytics, product, and engineering teams to understand data requirements and deliver reliable data solutions that power business intelligence and decision-making.
Required Key Skills & Tech Stack
- Core Skills: Microsoft Fabric Data Factory, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), PySpark, Advanced SQL.
- Data Concepts: ETL/ELT pipeline development, Data Lakehouse & Warehouse architectures, performance tuning, and complex data transformation.