Senior Python Developer with PySpark and AWS
Posted Updated
Description
Luxoft in Toronto is seeking a senior data engineer to support the Analytical Work Bench integration, including AWS-based data pipelines and Jupyter Lab IDE work. You will design and implement scalable data flows, collaborate with end users to gather requirements, and ensure code quality with standard testing practices.
Join a team that leverages PySpark, PyTest, and Pylint, while integrating with CI/CD tooling such as Jenkins and Urban Code to deliver robust, maintainable solutions in a
Integrate large datasets into the research ecosystem via the resource platform. Develop and maintain data pipelines and PySpark workflows. Collaborate with stakeholders to understand complex business needs and translate them into technical solutions. Bachelor's degree in Engineering or Computer Science required or preferred. 8+ years of hands-on Python and PySpark development experience. Experience with AWS cloud services and AWS EMR for big data processing. Solid testing & quality tooling with PyTest and Pylint. Experience with CI/CD pipelines (Jenkins, Urban Code) and end‑to‑end automation. Strong ability to gather requirements and collaborate with end users.Skills
Sign in to read and join the discussion.