DATA ENGINEER (AZURE)
Posted Updated
Description
Data Engineer (Azure)
Summary
We are seeking a skilled Data Engineer to design, build, and maintain robust data infrastructure within the IT Services sector. This pivotal role focuses on architecting scalable data solutions using Microsoft Azure technologies to ensure seamless data flow, integrity, and accessibility. The successful candidate will play a critical part in transforming raw data into actionable insights, supporting strategic business decisions through advanced data warehousing and analytics capabilities.
Responsibilities
- Design and implement scalable data storage and processing architectures utilizing Azure Data Lake Storage (ADLS) and Delta Lake.
- Develop and optimize complex ETL pipelines using Azure Data Factory (ADF) and PySpark to ensure efficient data movement and transformation.
- Build and manage data models and warehouses, leveraging Azure Synapse Analytics for high-performance querying and reporting.
- Construct and maintain data pipelines that integrate diverse data sources, ensuring accuracy and consistency across the ecosystem.
- Write and refine Python and SQL scripts to automate data processes, perform data quality checks, and support analytical workflows.
- Collaborate with cross-functional teams to define data requirements and deliver solutions that align with organizational goals.
Requirements
Requirements:
- Possess 4 to 9 years of professional experience in data engineering or a related technical field.
- Demonstrate deep proficiency with Azure cloud services, specifically Azure Data Lake Storage (ADLS) and Azure Synapse Analytics.
- Show strong expertise in data modeling, data warehousing concepts, and the implementation of Delta Lake architecture.
- Be highly skilled in developing ETL pipelines using Azure Data Factory (ADF) and executing big data processing with PySpark.
- Have a solid command of Python and SQL for data manipulation, scripting, and query optimization.
- Experience working within Databricks environments for collaborative data analysis and engineering is essential.
- Target compensation range is approximately ₹24 LPA, commensurate with experience and skill level.