Azure Data Engineer - PySpark/Databricks
Summary
Azure Data Engineer (5.5-8.5 yrs) designing and maintaining scalable ETL/ELT data pipelines on Azure using PySpark, Databricks, ADLS, Azure Data Factory, and advanced SQL. Day to day involves data integration, modeling, warehousing, and data quality work alongside analysts and scientists.
Role : Azure Data Engineer
Experience : 5.5 - 8.5 Years
Mandatory Skills :
- Python
- PySpark
- Databricks
- Azure Services - ADLS, Azure Data Factory (ADF), Azure Databricks (ADB)
- Advanced SQL
Key Responsibilities :
- Design, develop, and maintain scalable ETL/ELT data pipelines.
- Ensure data quality, reliability, and timely data processing.
- Build and manage seamless data integration solutions across multiple systems and sources.
- Develop and optimize data models for analytics and reporting.
- Manage and optimize relational and NoSQL databases for performance, scalability, and security.
- Work on data warehousing, data modeling, data strategy, and data quality initiatives.
- Collaborate with data analysts, data scientists, and business stakeholders to deliver effective data solutions.