Posted Updated
We are seeking a skilled Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have a strong background in data engineering, with expertise in ADF, PySpark, and SQL. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and architectures that support our data analytics and business intelligence initiatives.
Key Responsibilities:
- Design and implement robust data pipelines using Azure Data Factory (ADF) to ensure seamless data integration and transformation.
- Utilize PySpark for processing large datasets efficiently, ensuring high performance and scalability.
- Write complex SQL queries to extract, manipulate, and analyze data from various sources.
- Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions.
- Monitor and optimize data workflows to improve performance and reliability.
- Ensure data quality and integrity throughout the data lifecycle.
- Stay updated with the latest industry trends and technologies in data engineering.
Required Skills:
- Proficiency in Azure Data Factory (ADF) for data integration.
- Strong experience with PySpark for big data processing.
- Solid understanding of SQL for database management and data manipulation.
- Ability to work collaboratively in a team environment and communicate effectively with stakeholders.
- Problem-solving skills and a proactive approach to challenges.
If you are passionate about data engineering and want to make a significant impact in our organization, we encourage you to apply for this exciting opportunity.
See also
Data Engineering jobs by country — openings, pay and top skills →