Lead Python Data Engineer
Summary
Lead a team building and maintaining Python-based data pipelines and applications for regulatory reporting in finance, using Spark, Databricks, and Azure.
We're looking for a hands-on Lead Python Data Engineer to join the Poland-based Regulatory Reporting team within the Investment Bank's Digital Operations Stream, helping transform the client's business by simplifying and enhancing the products and platforms used by Regulatory and Data Clients.
Please be aware that this role requires 3 days per week on-site at the client's office.
Responsibilities
- Design, build and maintain data-driven applications, both new and existing
- Deliver end-to-end solutions
- Build reliable data pipelines for sourcing, processing, distributing and storing data
- Create data models capable of supporting growing data volumes
- Participate in all phases of the software development lifecycle
- Offer technical expertise, recommendations and innovative solutions
- Work closely with the product owner and fellow technologists
- Contribute to the engineering culture by sharing knowledge and best practices with colleagues
Requirements
- Bachelor's degree in Computer Science or a related IT field, with 7+ years in a comparable position
- Experience with Big Data, Data warehouses and Data lakes
- Demonstrated hands-on experience developing scalable data pipelines that process large volumes of data in both batch and stream modes for near real-time analytics
- Strong skills in Databricks, Python and Spark
- Working knowledge of Delta Lake, DLT and GitLab
- Understanding of Cloud technologies including Azure, Unix/Linux and shell scripting
- Skilled in designing applications that meet NFRs for high throughput and low latency data processing
- Experience creating automated functional tests and CI/CD pipelines using standard industry tools
- Ability to rapidly build prototypes and refine them into robust products using sound engineering practices
- Practical experience applying AI within the engineering SDLC
- English language skills at B2 level or above
Nice to have
- Skills in database development, including SQL, PL/SQL, PostgreSQL and Azure SQL
Benefits
We gather like-minded people:
- Top tech minds driving innovation in AI, cloud and digital platform modernization
- Supportive team and agile, startup-like culture
- Hybrid by design mode and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Business-driven relocation opportunities
We provide growth opportunities:
- Career development programs
- Thought leadership, mentoring, soft skills and well-being programs
- Certification (Anthropic, Gemini, GCP, Azure, AWS)
- English classes
We cover it all:
- Stable pay
- Participation in the Employee Stock Purchase Plan with a 15% discount
- Benefits package (health insurance, multisport, shopping vouchers)
- Referral bonuses up to $2,000
- Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
- Corporate, social and well-being events
Please, note:
- Benefits listed above are available to employees only
- We are open for working with Contractors. Terms of B2B cooperation agreements are agreed individually
- We will reach out to selected candidates exclusively