Senior Data Engineer
Summary
Senior Data Engineer at The Codest, developing and automating tools for a major European e-commerce platform's Data Platform. Tech stack: Python (primary), JVM languages, GCP (BigQuery, Composer, Dataproc, Cloud Run), SQL, PySpark, Docker.
Hello World! We are The Codest - International Tech Software Company with tech hubs in Poland delivering global IT solutions and projects. Our core values lie in 'Customers and People First' approach that prioritises the needs of our customers and a collaborative environment for our employees, enabling us to deliver exceptional products and services.
Project description:
Our client is one of the largest e-commerce platforms in Europe, used by millions of users every day. The company connects sellers - from small businesses to global brands - with customers, offering a vast product selection, fast delivery, and a well-crafted shopping experience.
The role:
- Development and automation of tools in the Data Platform area
- Supporting the Client's product, technical, and analytical teams in building products, including technology solutions and data-driven services
- Assisting the Client's technical and analytical teams in resolving issues reported through organizational communication channels (Slack, email, OpsGenie)
Job requirements:
- At least 5 years of commercial experience in data engineering.
- Code in Python (65% of tasks in the team) and JVM languages (Java, Kotlin, Scala; 35%).
- Know about Google Cloud Platform (BigQuery, Composer, Dataproc, Cloud Run) or other public cloud providers.
- Have a deep SQL and PySpark knowledge.
- Work leveraging good practices of software development: TDD, Clean Code, CI/CD, etc.
- Navigate efficiently in a Linux/Unix environment.
- Have experience with Docker.
- Work with git or other version control system.
- Interested in emerging technologies like Generative AI and its applications.
- Possess team-working skills and a positive attitude.
- Eager for personal development, keeping their knowledge up-to-date, and taking an active part in the development of current solutions.
- English level min. B2+.
Nice to have:
- Know Apache Beam and Google Dataflow
- Know Terraform or other IaaC tools
- Have experience in Spark or PySpark - not necessarily in a Hadoop environment
Our offer:
- 20-26k PLN on a B2B contract
- Access to the Worksmile platform
- A work environment that values growth and innovation - you bring the ideas, and we want to hear them
Recruitment process:
- 30-minute screen with our recruiter, Justyna
- 1h technical interview
- 1h interview with the client
- Offer