Walk-in || Azure Data Engineer
Requirement : Azure Data Engineer
Location: Bengaluru
Experience : 3Years - 8years
Role : B2/Senior consultant
B3/Lead Consultant
Job Description:
We are seeking a highly skilled ETL Data Migration Engineer with 4 to 7 years of experience in designing, developing, and implementing large-scale data migration and data integration solutions on the Azure platform. The ideal candidate will have strong hands-on expertise in Azure Data Factory (ADF), Azure Databricks, SQL, PySpark, Python, and Azure DevOps. The candidate will be responsible for migrating data from legacy systems to modern Azure-based data platforms while ensuring data quality, performance, and reliability.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory (ADF).
- Build and optimize data transformation processes using Azure Databricks and PySpark.
- Perform end-to-end data migration activities from legacy systems to Azure-based data lakes and data warehouses.
- Analyze source-to-target mappings and implement complex business transformation logic.
- Develop reusable data ingestion frameworks and automation solutions.
- Write efficient and optimized SQL queries, stored procedures, and performance tuning solutions. Implement data validation, reconciliation, and data quality checks during migration activities.
- Collaborate with Business Analysts, Architects, QA teams, and stakeholders to understand data requirements. Support deployment, release management, and CI/CD processes using Azure DevOps.
- Troubleshoot production issues and provide timely resolutions.
- Participate in code reviews and ensure adherence to development best practices.
- Create and maintain technical documentation, migration runbooks, and deployment guides. Support Agile ceremonies including Sprint Planning, Daily Scrum, Retrospectives, and Release activities
Thankyou
Yathin Kumar N
Senior Recruiter