Data Engineer

We are seeking a skilled Data Engineer to join our dynamic team in Maharashtra. The ideal candidate will have a strong background in designing and implementing data pipelines using Azure Data Factory (ADF) and will be proficient in Python scripting. As a Data Engineer, you will play a crucial role in managing and optimizing our data architecture, ensuring that data flows seamlessly from various sources to our data lakes and warehouses. Key Responsibilities: - Design, develop, and maintain robust data pipelines using Azure Data Factory to facilitate data integration and transformation. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Implement best practices for data management, including data quality, security, and governance. - Monitor and troubleshoot data pipeline performance, making necessary adjustments to optimize efficiency. - Work with Azure Data Lake Storage (ADLS) to store and manage large volumes of data effectively. - Document data processes and workflows to ensure transparency and knowledge sharing within the team. Required Skills: - Proficiency in Azure Data Factory and experience in building data pipelines. - Strong knowledge of Azure Data Lake Storage (ADLS) and its integration with data processing tools. - Expertise in Python scripting for data manipulation and automation tasks. - Familiarity with data modeling and ETL processes. - Excellent problem-solving skills and the ability to work collaboratively in a team environment. If you are passionate about data engineering and eager to contribute to innovative data solutions, we encourage you to apply for this exciting opportunity.