Senior Data Engineer

We are seeking a highly skilled Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in designing and implementing data solutions using AWS technologies. As a Senior Data Engineer, you will be responsible for building and maintaining data pipelines, ensuring data quality, and optimizing data storage and retrieval processes. You will work closely with data scientists and analysts to provide them with the necessary data infrastructure to support their analytical needs. Key Responsibilities: - Design, develop, and maintain scalable data pipelines using AWS services such as Glue, Lambda, and S3. - Implement data processing workflows using AWS Step Functions and Athena. - Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs. - Optimize SQL queries and PySpark jobs for performance and efficiency. - Ensure data integrity and quality through rigorous testing and validation processes. - Stay updated with the latest industry trends and technologies to continuously improve data engineering practices. Required Skills: - Strong experience with AWS services, particularly Glue, Lambda, S3, Step Functions, and Athena. - Proficiency in Python and SQL for data manipulation and analysis. - Experience with big data technologies, particularly PySpark. - Excellent problem-solving skills and the ability to work in a fast-paced environment. - Strong communication skills to collaborate effectively with team members and stakeholders. If you are passionate about data engineering and have a proven track record of delivering high-quality data solutions, we would love to hear from you.