Lead Data Engineer

We are seeking a highly skilled Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and architecture, with a focus on leveraging Python, SQL, and Apache Spark to build robust data pipelines and ETL processes. As a Lead Data Engineer, you will play a crucial role in designing and implementing data solutions that meet the needs of our organization and drive data-driven decision-making. Key Responsibilities: - Design, develop, and maintain scalable data pipelines and ETL processes to support data ingestion and transformation. - Collaborate with data architects and other stakeholders to define data architecture and ensure data quality and integrity. - Utilize Python and SQL to manipulate and analyze large datasets, providing insights and recommendations based on data analysis. - Implement best practices for data engineering, including data governance, security, and performance optimization. - Lead and mentor a team of data engineers, fostering a culture of continuous improvement and innovation. - Stay up-to-date with the latest trends and technologies in data engineering and analytics, and evaluate their potential application within the organization. Required Skills: - Proficiency in Python and SQL, with experience in data manipulation and analysis. - Strong knowledge of Apache Spark and its ecosystem for big data processing. - Experience with ETL tools and frameworks, and a solid understanding of data warehousing concepts. - Excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment. - Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders. If you are passionate about data engineering and want to make a significant impact in a growing organization, we encourage you to apply for this exciting opportunity.