Lead Data Engineer

We are seeking a highly skilled Lead Data Engineer to join our dynamic team in Tamil Nadu. The ideal candidate will have extensive experience in data engineering, with a strong focus on leveraging modern technologies to build robust data pipelines and architectures. As a Lead Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data solutions that support our business objectives. Key Responsibilities: - Lead the design and development of data pipelines using Python, PySpark, and Databricks. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Implement data models and architectures in Azure to ensure efficient data storage and retrieval. - Mentor and guide junior data engineers, fostering a culture of continuous learning and improvement. - Monitor and optimize data processing workflows for performance and reliability. - Ensure data quality and integrity through rigorous testing and validation processes. - Stay updated with the latest industry trends and technologies to drive innovation within the team. Required Skills: - Proficiency in Python and PySpark for data processing and analysis. - Experience with Databricks for building and managing data pipelines. - Strong knowledge of Azure cloud services and data architecture. - Proven ability to lead technical projects and teams effectively. - Excellent problem-solving skills and attention to detail. - Strong communication skills to collaborate with stakeholders and team members. If you are passionate about data engineering and looking to take your career to the next level, we encourage you to apply for this exciting opportunity.