Python/PySpark developer and Data Engineer
Summary
Senior Python developer and data engineer at Luxoft Kraków building a new data and application platform for an investment-banking client: designing Python back-end services and APIs, building PySpark/Databricks data pipelines, maintaining CI/CD in Azure DevOps, and mentoring the team.
We are looking for a senior Python developer to join our client's team and lead the build of a new data and application platform. The team focuses on clean code, agile methodologies, and high-quality delivery. The client is from the investment banking industry.
Responsibilities
Design, develop, and maintain scalable back-end services and APIs using Python
Build and optimize data pipelines and workloads on Databricks
Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps
Advise and guide the team on architecture, design decisions, and best practices while the new platform is built
Mentor developers and raise the technical level of the team through code reviews and pair programming
Define and consume RESTful APIs, clearly communicating requirements and constraints across teams
Translate business and product requirements into robust technical solutions
Apply clean code principles and contribute to continuous improvement of engineering standards and tooling
Write and maintain automated tests (unit, integration)
Participate actively in agile ceremonies (Scrum/Kanban), including refinement, planning, reviews, and retrospectives
Work closely with QA, product managers, and architects to ensure high-quality, business-aligned deliveries
Support and improve existing applications in a fast-paced, enterprise investment-banking environment
Must have
At least 8 years of professional software development experience, including long-term projects
Hands-on experience with PySpark and distributed data processing
Proven experience designing, building and maintaining ETL pipelines
Hands-on experience with Databricks
Experience in automated testing of data pipelines and applications
Excellent problem-solving skills
Familiarity with agile practices (Scrum, Kanban, etc.)
Good communication skills and the ability to state requirements clearly to other teams
Nice to have
Hands-on experience with Oracle, including strong SQL skills and query and performance tuning
Good working knowledge of Unix/Linux and shell scripting
Experience scheduling and monitoring batch jobs with Autosys