Python developer
Description
Roles and Responsibilities
- Design, develop, test, and deploy scalable data pipelines using AWS services such as S3, Lambda, Step Functions.
- Develop high-quality code in Python with expertise in Fast API development.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Ensure seamless integration of PySpark applications with other systems through effective communication and collaboration.
- Troubleshoot issues related to pipeline failures or errors by analyzing logs, debugging techniques.
Desired Candidate Profile
- 5-8 years of experience in software development with a focus on data engineering using Python programming language.
- Strong understanding of AWS ecosystem including S3, Lambda functions, Step Functions etc. .
- Proficiency in developing fast APIs using Python frameworks like Flask or Django.
- Experience working with big data technologies like Spark (PySpark) for data processing tasks.