Data Engineer
Summary
Data engineer (Regular to Senior) hired via Infotree to work from Poland for an Ireland-based client, building and optimising a highly scalable Data Mesh powering cross-product use cases. Core stack: Apache Spark ETL at scale, Apache Iceberg, Terraform/AWS, Jenkins CI/CD, in a 6-person data team on EU hours.
Role: Data Engineer (Transport Focus)
Seniority: Regular, Regular+, or Senior
Client:
A technology company building and optimising a highly scalable Data Mesh that powers cross-product use cases across their platform.
Client Location: Ireland
Work Location: Poland
Project Description:
Development and optimisation of a Data Mesh supporting use cases across various products within the client’s platform. The work involves building and maintaining large-scale data processing infrastructure and data transformation logic.
This is a critical, hands‑on engineering role focused on building and optimising a highly scalable and reliable Data Mesh that powers cross-product use cases across the platform. The engineer will build and support large-scale data processing infrastructure and transformation logic.
Tech Stack:
Core Technologies:
- Apache Spark – deep, proven experience required, including:
- Deployment, management, and cost optimisation of Spark clusters
- Writing high-performance Spark ETL jobs
- Ideally, experience writing to large analytical tables (e.g., Apache
- Iceberg)
- Infrastructure as Code (IaC): Terraform, experience with AWS
- CI/CD: Jenkins
- Testing: Unit, Integration, and End-to-End testing
Team Structure:
- 3x Data Engineers
- 1x Data Operator
- 2x Python Developers
Working Hours: EU timezone
Language Level:
Excellent verbal and written communication skills required – ability to clearly communicate technical decisions to Project Managers and Operational Teams.
Additional Information:
- Background check required
Key candidate traits:
- Exceptional analytical and problem-solving skills
- Ability to debug complex cross-service issues
- Strong adherence to Clean Code principles