Lead Data Engineer
Posted Updated
Summary
Leads data engineering projects in Chennai, designing and maintaining scalable data pipelines and architectures with Python, Azure, PySpark, and Databricks, while mentoring a team of data engineers and collaborating with data scientists and stakeholders to deliver high-quality data solutions.
We are seeking a highly skilled Lead Data Engineer to join our dynamic team in Tamil Nadu. The ideal candidate will have extensive experience in designing and implementing data solutions using modern technologies. As a Lead Data Engineer, you will be responsible for leading data engineering projects, collaborating with cross-functional teams, and ensuring the successful delivery of data solutions that meet business needs.
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and architectures using Python, Azure, Pyspark, and Databricks.
- Lead and mentor a team of data engineers, providing guidance and support in best practices and technical challenges.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize data processing workflows for performance and efficiency.
- Ensure data quality and integrity through rigorous testing and validation processes.
- Stay updated with the latest industry trends and technologies to continuously improve data engineering practices.
Required Skills:
- Proficiency in Python and experience with data processing frameworks such as Pyspark.
- Strong knowledge of Azure cloud services and data engineering tools.
- Experience with Databricks for data analytics and processing.
- Excellent problem-solving skills and the ability to work in a fast-paced environment.
- Strong communication and leadership skills to effectively manage a team and collaborate with stakeholders.
If you are passionate about data engineering and looking to take your career to the next level, we encourage you to apply for this exciting opportunity.