Azure Data Engineer
Summary
Designs and maintains large-scale data pipelines on Azure using Data Factory and Data Lake Storage, develops optimized SQL for Azure databases, implements Delta Live Tables in Synapse Analytics, and builds ETL/reporting with SSIS and SSRS. On-site roles in Hyderabad or Chennai for experienced (8-13 yrs) engineers.
Roles and Responsibilities
- Design, develop, test, deploy, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data Lake Storage.
- Collaborate with cross-functional teams to gather requirements for data processing needs and design solutions that meet business needs.
- Develop complex SQL queries to optimize database performance and troubleshoot issues in Microsoft Azure databases.
- Implement Delta Live Tables for real-time data ingestion and processing in Azure Synapse Analytics.
- Integrate SSIS packages for ETL processes and create reports using SSRS.