Data Engineer
Posted 5
views
Referral available at Incedo
An employee here can refer you. The referrer stays anonymous and reaches out to you directly if interested.
Description
Roles and Responsibilities :
- Design, develop, test, deploy and maintain large-scale data pipelines using AWS services such as S3, Lambda, Step Functions.
- Collaborate with cross-functional teams to gather requirements and design solutions for complex data processing needs.
- Develop high-quality code in Python using PySpark and SQL to process large datasets.
- Troubleshoot issues related to data pipeline failures and optimize performance.
Job Requirements :
- 5-8 years of experience in a similar role as an AWS Data Engineer or equivalent.
- Strong proficiency in Python programming language with expertise in PySpark.
- Experience working with AWS services including S3, Lambda, Step Functions.