Azure Data Engineer

Job Description: Senior Azure Data Engineer

Role Summary

We are looking for a Senior Azure Data Engineer with strong hands-on experience in building, optimizing, and maintaining scalable data pipelines and cloud-based data platforms using Microsoft Azure. The ideal candidate should have expertise in data engineering, Lakehouse architecture, and working with distributed teams to deliver high-quality data solutions.

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Synapse Pipelines.
• Build and optimize data processing solutions using Azure Databricks, PySpark, SQL, and Delta Lake.
• Work with Azure Data Lake Storage Gen2, Azure Synapse Analytics, and Microsoft Fabric.
• Implement Lakehouse and Medallion architectures for batch and real-time data processing.
• Ensure data quality, governance, security, and compliance across data platforms.
• Optimize pipeline performance, troubleshoot issues, and manage data integration workflows.
• Implement CI/CD pipelines using Azure DevOps and Infrastructure as Code.
• Collaborate with architects, business stakeholders, and distributed engineering teams.

Required Skills & Experience

• 7+ years of experience in data engineering, with strong hands-on experience in Azure data services.
• Strong expertise in Azure Data Factory, Azure Databricks, Azure Data Lake Storage Gen2, and Azure Synapse Analytics.
• Proficiency in SQL, Python/PySpark, Spark performance tuning, and Delta Lake.
• Experience with Lakehouse, Medallion architecture, and data modeling.
• Knowledge of data governance, security, metadata management, and Azure DevOps CI/CD.
• Working knowledge of Microsoft Fabric is preferred.
• Strong problem-solving, communication, and collaboration skills.

Preferred Qualifications

• Microsoft Azure Data Engineer Associate or equivalent certification.
• Experience with large-scale data migrations and enterprise data platforms.
• Exposure to Life Sciences or Pharma domain and Veeva CTMS is an advantage.
• Familiarity with AI/ML data pipelines and modern cloud data architectures.