Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions that drive business insights and decision-making. As a Senior Data Engineer, you will be responsible for building and maintaining robust data pipelines, ensuring data quality, and optimizing data storage and retrieval processes. You will work closely with data scientists, analysts, and other stakeholders to understand their data needs and deliver solutions that meet those requirements. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using Databricks and PySpark. - Collaborate with cross-functional teams to gather requirements and translate them into technical specifications. - Ensure data integrity and quality through rigorous testing and validation processes. - Optimize data storage and retrieval processes to improve performance and efficiency. - Monitor and troubleshoot data pipeline performance issues, implementing solutions as needed. - Stay updated with the latest industry trends and technologies to continuously improve data engineering practices. Required Skills: - Proficiency in Databricks and PySpark. - Strong understanding of data modeling, ETL processes, and data warehousing concepts. - Experience with cloud platforms and big data technologies. - Excellent problem-solving skills and attention to detail. - Strong communication skills to effectively collaborate with team members and stakeholders. If you are passionate about data engineering and want to make a significant impact in a fast-paced environment, we encourage you to apply for this exciting opportunity.