Azure Data Engineer - Medallion Architecture

About the Role :

Key Responsibilities :

- Design, develop, and optimize ETL/ELT pipelines using Azure Data Lake, Azure Databricks, and PySpark.

- Implement Medallion Architecture (Bronze/Silver/Gold) to support data quality and governance.

- Build and maintain data models using Star and Snowflake schemas for reporting and analytics.

- Collaborate with data scientists and business stakeholders to translate requirements into technical solutions.

- Manage CI/CD workflows with GitHub or Azure DevOps, ensuring automated testing and deployment.

- Monitor pipeline performance, troubleshoot issues, and implement improvements.

- Enforce data quality and governance standards across all data assets.

Required Skills :

- 5 - 8 years of experience in Azure Data Engineering

- Strong expertise in Azure Databricks, PySpark, SQL, dbt, and Airflow

- Experience building scalable ETL/ELT pipelines on Azure Data Lake

- Hands-on experience with Medallion Architecture (Bronze/Silver/Gold)

- Strong data modelling skills (Star/Snowflake schemas)

- Knowledge of CI/CD, GitHub/Azure DevOps, and data quality/governance practices

- Good understanding of analytics, reporting, and AI/ML data platforms

- Databricks certification is required

- DBT Experience required