Senior Data Engineer

We are seeking a Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and be proficient in technologies such as Pyspark, SQL, and Databricks. As a Senior Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines that support our data-driven decision-making processes. Key Responsibilities: - Design and implement robust data pipelines using Pyspark to process large datasets efficiently. - Develop and optimize SQL queries for data extraction, transformation, and loading (ETL) processes. - Collaborate with data scientists and analysts to understand data requirements and deliver high-quality data solutions. - Utilize Databricks for data processing and analytics, ensuring optimal performance and reliability. - Monitor and troubleshoot data pipeline performance, implementing improvements as necessary. - Stay updated with the latest industry trends and technologies in data engineering to continuously enhance our data infrastructure. Required Skills: - Proficiency in Pyspark for big data processing. - Strong SQL skills for data manipulation and querying. - Experience with Databricks for data analytics and processing. - Ability to work collaboratively in a team environment and communicate effectively with stakeholders. - Strong problem-solving skills and attention to detail. If you are passionate about data engineering and eager to work in a fast-paced environment, we encourage you to apply for this exciting opportunity.