Lead Data Engineer

We are seeking a highly skilled Lead Data Engineer to join our dynamic team in Karnataka. The ideal candidate will have extensive experience in designing and implementing data solutions that leverage modern data engineering practices. As a Lead Data Engineer, you will be responsible for overseeing the development and maintenance of data pipelines, ensuring data quality, and optimizing data workflows. You will work closely with data scientists, analysts, and other stakeholders to understand their data needs and deliver robust solutions that support business objectives. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Python, PySpark, and Databricks. - Implement Medallion Architecture to enhance data processing and analytics capabilities. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Ensure data integrity and quality through rigorous testing and validation processes. - Mentor and guide junior data engineers, fostering a culture of continuous learning and improvement. - Stay updated with the latest industry trends and technologies to drive innovation within the team. Required Skills: - Proficiency in Python and PySpark for data processing and analysis. - Experience with Databricks for building and managing data pipelines. - Familiarity with MS Fabric and its applications in data engineering. - Strong understanding of Medallion Architecture principles. - Excellent problem-solving skills and the ability to work in a fast-paced environment. If you are passionate about data engineering and have a proven track record of leading successful data projects, we encourage you to apply for this exciting opportunity.