Data Engineer
Summary
A Data Engineer in Kraków (hybrid, 6 days/month on-site) who builds and optimizes high-performance data processing pipelines, turning experimental code into production-ready, scalable workflows. Core stack: PySpark, advanced SQL, Spark (on YARN), and the Hadoop ecosystem.
Kraków (hybrid - 6 days/month in the office)
We’re looking for an experienced Data Engineer to join a team focused on building and optimizing high-performance data processing solutions. You’ll work with modern data technologies, transforming experimental code and features into scalable, reliable, and performant workflows and modules.
About the role
You’ll be part of a team responsible for developing and optimizing data processing solutions, with a strong focus on PySpark and advanced SQL. Your role will involve turning experimental implementations into production-ready workflows, improving Spark performance, and working within the Hadoop ecosystem.
- Develop and maintain data processing solutions using PySpark and Spark
- Convert experimental code and features into performant, production-ready workflows and modules
- Design, implement, and optimize data processing pipelines
- Perform advanced SQL development and data analysis
- Optimize Spark applications for performance and scalability
- Work within the Hadoop ecosystem, including Spark on YARN
- Troubleshoot and improve data processing workflows
- Support the implementation of scalable and reliable data solutions
- Strong experience with PySpark and data engineering
- Advanced SQL skills
- Strong experience in Spark development and Spark optimization
- Hands-on experience with the Hadoop ecosystem
- Experience working with Spark on YARN
- Strong understanding of data processing and distributed computing
- Experience developing performant and scalable data workflows
- GCP experience - nice to have
- Strong troubleshooting and analytical skills
What we offer
- B2B contract
- Private medical care, life insurance, and access to Multisport card
- Stable, long-term projects with full-time employment