Azure Data Engineer
Posted Updated
Description
We are seeking an experienced Azure Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have a strong background in data engineering, particularly with Azure technologies. As an Azure Data Engineer, you will be responsible for designing, building, and maintaining data pipelines and architectures that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Develop and maintain robust data pipelines using Azure Data Factory, ensuring data is processed efficiently and accurately.
- Utilize PySpark for data transformation and processing tasks, optimizing performance and scalability.
- Write complex SQL queries to extract, manipulate, and analyze data from various sources.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets.
- Monitor and troubleshoot data pipeline performance, implementing improvements as necessary.
- Ensure data quality and integrity throughout the data lifecycle.
- Stay updated with the latest Azure technologies and best practices in data engineering.
Required Skills:
- Proficiency in Azure Data Factory and its components.
- Strong experience with PySpark for data processing.
- Solid understanding of SQL for database management and data manipulation.
- Familiarity with data warehousing concepts and practices.
- Excellent problem-solving skills and attention to detail.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
If you are passionate about data engineering and have the skills to drive data solutions in a cloud environment, we encourage you to apply for this exciting opportunity.