Data Engineer ( Python&PySpark)
Posted Updated
Summary
Builds and migrates large-scale financial data pipelines using Python and PySpark on Azure, designing cloud-native architectures for a global fintech infrastructure provider.
We are currently looking for a Data Engineer (Python & PySpark) on behalf of our client to join a high-impact project within a leading global financial infrastructure and data provider.
The role is hybrid (2–3 days onsite per week), based in Gdańsk or Gdynia, Poland.
If you have strong experience in Python, PySpark, and working with large-scale data processing systems, this could be a great opportunity to work on meaningful, data-driven financial solutions in a global environment.
Responsibilities
- Assess the current application and work with application architect to decide on transformation strategy.
- Determine application complexity and effort.
- Work with the architects to determine target architecture.
- Plan backlog of activities to be completed by development team.
- Work with development team to transition applications from planning to transformation.
- Support Customer UAT activities.
Technical Skills
- Azure/Fabric
- PySpark services experience
- Dev/Ops experience with Azure
- AKS
- Azure SQL or PostgreSQL DB
- OneLake
- Delta DB
Desired Skills
- CosmosDB
- NoSQL variant
- Postgres variant
- Data Flow Gen 2
Functional Skills
- DBOR data flows
- DBOR data processing and schemas
- Strategic Data Model (SDM)
Competencies
- Digital: Python
- Digital: DevOps
- Digital: PySpark
Benefits
- Stable long-term cooperation with opportunity for extension
- Opportunity to work with modern technologies in an international environment
- Professional growth and continuous development opportunities
- Participation in challenging and impactful projects