Data Engineer

Roles and Responsibilities :

• Design, develop, test, and deploy large-scale data pipelines using AWS services such as S3, Lambda, Step Functions.
• Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
• Develop high-quality code in Python using PySpark and Data Bricks to process massive datasets.
• Troubleshoot issues related to data pipeline failures and optimize performance for improved efficiency.

Job Requirements :

• 6-9 years of experience in a similar role as a Data Engineer or Software Development Engineer (SDE).
• Strong proficiency in Python programming language with expertise in working with big data technologies like PySpark and Data Bricks.
• Experience with cloud computing platforms such as AWS including S3, Lambda, Step Functions etc.