Lead Data Engineer

We are seeking a skilled Lead Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and will be responsible for designing, building, and maintaining scalable data pipelines and architectures. You will work closely with data scientists and analysts to ensure that data is accessible and usable for analysis and reporting. Key Responsibilities: - Design and implement robust data pipelines using technologies such as Pyspark and Databricks. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Optimize data storage and retrieval processes in cloud environments, particularly using Azure and Synapse. - Ensure data quality and integrity through rigorous testing and validation processes. - Mentor and guide junior data engineers, fostering a culture of continuous learning and improvement. - Stay updated with the latest industry trends and technologies to enhance our data engineering capabilities. Required Skills: - Proficiency in Pyspark and Databricks for data processing and analytics. - Strong programming skills in Python. - Experience with Azure cloud services and Synapse for data management. - Solid understanding of data engineering principles and best practices. - Excellent problem-solving skills and the ability to work in a fast-paced environment. If you are passionate about data and have the skills to lead a team in building innovative data solutions, we would love to hear from you.