AZURE DATA ENGINEER
Posted Updated
Description
Summary
We are seeking a highly skilled Azure Data Engineer to join our IT Services team. In this pivotal role, you will design, build, and maintain robust data solutions that drive business intelligence and analytics. You will be responsible for architecting scalable data pipelines and leveraging advanced technologies to transform raw data into actionable insights, ensuring our organization stays at the forefront of data innovation.
Responsibilities
- Design and implement enterprise-grade data solutions using Azure Synapse Analytics and Azure Databricks.
- Develop sophisticated data models and optimize database performance through advanced SQL scripting and data modeling techniques.
- Create interactive dashboards and reports using Power BI to support strategic decision-making across the organization.
- Engineer scalable data processing workflows utilizing PySpark and Python for complex data transformations and analysis.
- Implement and manage data governance frameworks, including the use of Unity Catalog within the Azure Databricks ecosystem.
- Explore and integrate Generative AI capabilities, specifically leveraging tools like Databricks Genie, to enhance data processing and analytics.
- Collaborate with cross-functional teams to define data requirements and deliver high-quality engineering solutions.
Requirements
Requirements:
- Possess 8 to 12 years of professional experience in data engineering and related technical fields.
- Demonstrate deep expertise in Azure Synapse, Azure Databricks, and Unity Catalog environments.
- Show proficiency in Generative AI applications, including experience with Databricks Genie.
- Be highly skilled in PySpark and Python for coding, scripting, and data manipulation tasks.
- Exhibit strong command of SQL and SQL scripting for complex query optimization and data extraction.
- Have a proven track record in data modeling and architecture design.
- Display the ability to create compelling visualizations and reports using Power BI.
- Hold a competitive salary expectation aligned with the market range of ₹22-24 LPA.