Azure Data Engineer
Summary
Azure Data Engineer (3-6 yrs) at Honeybee Tech Solutions, working for client Atlas Copco in Pune. Day to day: build and maintain scalable ETL/ELT pipelines and data models on Azure using Data Factory, Databricks, Synapse, ADLS, and Azure SQL, with strong Python, PySpark, and SQL skills.
We have an urgent requirement for an Azure Data Engineer with 3+ years of experience for our client Atlas Copco.
Must-Have Skills
- 4 to 7 years of relevant experience in Azure Data Engineering
- Strong experience with Azure Data Services
- Hands-on experience with ETL technologies and techniques
- Strong hands-on experience with Python
- Advanced SQL skills
- Strong knowledge of Python & PySpark
- Experience with Data Warehouse Design Concepts
- Hands-on experience with:
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics
- Azure Data Factory (ADF)
- Azure Databricks
- Azure SQL Database
- Experience with Data Warehouse, Data Lake, and Big Data Platform technologies
- Good understanding of data modelling, including conceptual, logical, and physical data models
- Experience optimizing data pipelines for performance
- Strong communication and collaboration skills
Good-to-Have Skills
- Azure Logic Apps
- Azure Functions
- Azure Stream Analytics
- Microsoft Purview
- Machine Learning project exposure
- Terraform
- ARM Templates
- Azure DevOps
- Azure Monitoring & Alerting
Key Responsibilities
- Develop and deploy scalable data solutions on the Azure Cloud Platform
- Build and maintain ETL/ELT data pipelines from various data sources
- Work with Azure Data Factory, Databricks, Synapse, ADLS, and Azure SQL
- Collaborate with business and technical teams to understand data requirements
- Translate business requirements into production-ready data solutions
- Design and maintain data models based on business requirements
- Ensure data quality, security, governance, and compliance
- Optimize data pipelines and database designs for performance
- Maintain clear technical documentation for data pipelines and solutions
- Troubleshoot and resolve data performance and integration issues
Role Summary
The Azure Data Engineer will be responsible for building and maintaining scalable data pipelines and integration solutions on the Azure Data Platform. The role involves delivering secure, reliable, and high-performance data solutions using Azure Data Factory, Azure Databricks, Azure Synapse, ADLS, and Azure SQL, while ensuring data quality, governance, and performance.