Python Developer
Posted Updated
Summary
Design, develop, test, and deploy big-data pipelines using PySpark on AWS (S3, Lambda, EMR), collaborate with cross-functional teams on requirements, and troubleshoot pipeline failures. Requires 5-8 years of Python/PySpark experience.
Roles and Responsibilities :
- Design, develop, test, and deploy data pipelines using PySpark on AWS cloud platform.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions.
- Develop scalable and efficient algorithms for big data processing and analysis.
- Troubleshoot issues related to data pipeline failures or errors.
Job Requirements :
- 5-8 years of experience in Python development with expertise in PySpark.
- Strong understanding of AWS services including S3, Lambda, EMR, etc.
- Experience working with large datasets and developing complex data pipelines.
- Proficiency in writing clean, well-documented code that meets industry standards.