Data Engineering Platforms On Microsoft Azure
Posted 3
views
Summary
Designs and leads scalable data engineering platforms on Microsoft Azure, building large-scale data warehouses with Azure Data Factory and Synapse Analytics, and ensuring reliability through monitoring and DevOps/CI/CD practices. Requires 10+ years managing large-scale databases and strong SQL Server administration expertise.
Job Description
Data engineering platforms on Microsoft Azure
Roles and Responsibilities
- Design and implement scalable data engineering platforms on Microsoft Azure.
- Lead the setup and management of Azure-based data engineering environments.
- Develop and maintain large-scale data warehousing solutions using Azure Data Factory (ADF) and Synapse Analytics.
- Collaborate with cross-functional teams to gather requirements and design optimized data processing pipelines and scalable architectures.
- Ensure high availability, reliability, and performance of cloud-based systems through effective monitoring and DevOps practices.
- Provide expert guidance on best practices for migrating data workloads to the Azure cloud environment.
Desired Candidate Profile
- Minimum of 10 years of experience in managing and maintaining large-scale databases.
- Bachelor’s degree in Engineering or a related field (B.Tech/B.E.).
- Strong expertise in SQL Server database administration, including database design, maintenance, performance tuning, and troubleshooting.
- Hands-on experience with DevOps tools and CI/CD pipeline management.
Key Skills
- Azure Cloud Platform
- Azure Synapse Analytics
- Azure Data Factory (ADF)
- Data Engineering Platform Design
- Gateway Configuration
- Single Sign-On (SSO) Implementation
- CI/CD and DevOps Integration