Senior Azure Data Engineer - ETL/ELT Pipelines

Job Title : Azure Data Engineer

Experience : 68 Years

Location : Bangalore | Hyderabad | Chennai

Role Summary :

We are looking for an experienced Azure Data Engineer with strong expertise in Azure data services, PySpark, Python, and data migration testing. The candidate will design and maintain scalable data pipelines and ensure data quality and accuracy.

Key Responsibilities :

- Develop and optimize ETL/ELT pipelines using Azure services.

- Build scalable data processing solutions using PySpark & Python.

- Perform data migration testing, validation, reconciliation, and data quality checks.

- Work with stakeholders and data architects to understand requirements.

- Monitor and troubleshoot data pipelines.

- Follow data governance, security, testing, and CI/CD best practices.

Required Skills:

- Strong hands-on experience in Microsoft Azure

- Expertise in Azure Data Factory (ADF)

- Experience with Azure Data Lake Storage (ADLS)

- Hands-on experience in Azure Synapse Analytics & Azure Databricks

- Strong knowledge of PySpark & Python

- Excellent SQL skills

- Experience in ETL/ELT development

- Expertise in Data Migration Testing, Validation & Reconciliation

- Strong understanding of Data Quality

- Knowledge of Git, CI/CD & Azure DevOps