Principal Software Engineer (Data Platform)
Summary
Senior/Principal Azure Data Engineer building scalable data platforms: designing ETL/ELT pipelines with Azure Data Factory and Databricks, transforming data with PySpark/Spark SQL and Delta Lake, and maintaining a lakehouse on ADLS Gen2 with Synapse, Event Hub, and Key Vault/SharePoint integrations. Requires 5+ years of Azure data engineering and UAE business-hours availability.
Experience: 5+ Years
Location: Hybrid – Pakistan
Working Hours: UAE Business Hours
Job Summary
We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.
Key Skills
- Azure Data Factory
- Azure Databricks
- Azure Synapse Analytics
- Azure Event Hub
- Azure Data Lake Storage Gen2
- Azure Logic Apps & Function Apps
- Azure SQL Database
- Azure Key Vault
- Microsoft SharePoint Integration
- PySpark & Spark SQL
- Delta Lake & Delta Tables
- Data Lakehouse Architecture
Responsibilities
- Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
- Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
- Build and maintain Data Lakehouse solutions using ADLS Gen2.
- Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
- Implement secure integrations using Azure Key Vault and SharePoint.
- Troubleshoot and optimize data pipelines and Spark workloads.
Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.