Lead Data Engineer
Posted Updated 29
views
Summary
Lead Data Engineer in Chennai who designs, builds, and maintains scalable data pipelines and architectures using Python, Azure, PySpark, and Databricks. The role includes optimizing data workflows, ensuring data quality, and mentoring junior data engineers.
We are seeking a highly skilled Lead Data Engineer to join our dynamic team in Tamil Nadu. The ideal candidate will have extensive experience in data engineering, with a strong focus on Python, Azure, Pyspark, and Databricks. As a Lead Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support our data-driven initiatives.
Key Responsibilities:
- Lead the design and implementation of data solutions that meet business requirements.
- Collaborate with cross-functional teams to gather and analyze data requirements.
- Develop and maintain data pipelines using Python, Pyspark, and Databricks.
- Optimize data processing workflows for performance and efficiency.
- Ensure data quality and integrity throughout the data lifecycle.
- Mentor and guide junior data engineers, fostering a culture of continuous learning and improvement.
- Stay updated with the latest industry trends and technologies in data engineering.
Required Skills:
- Proficiency in Python and experience with data engineering frameworks.
- Strong knowledge of Azure cloud services and data solutions.
- Experience with Pyspark for big data processing.
- Familiarity with Databricks for collaborative data engineering.
- Excellent problem-solving skills and attention to detail.
- Strong communication and teamwork abilities.
If you are passionate about data engineering and looking to take your career to the next level, we encourage you to apply for this exciting opportunity.