Senior Data Engineer
Posted Updated 7
views
You will design and operate the tools and data storage that power our software and AI research, working with identity documents, biometric data, and verification records. You'll play a key role in designing and building our next-generation data lake, shaping its architecture from the ground up and bringing technical leadership and ownership to the team.
Responsibilities
- Define and own data storage and data management architecture for software and AI/ML workflows
- Develop and maintain tools and services that AI & ML R&D teams and engineering teams rely on, including workflow orchestration platforms and test campaign infrastructure
- Manage and analyze large data volumes
- Set up and maintain backend APIs and services that provide reliable and secure internal data access
- Operate and evolve the platform infrastructure (CI/CD, containerization, deployments) with a strong focus on quality
- Enforce data access policies and GDPR compliance rules on research datasets, ensuring proper governance, traceability, and data minimization
- Collaborate closely with internal stakeholders (ML teams, product design and development, QA, devops) in an agile environment
Requirements
- Application development in Python (tooling, services, data scripts, packaging)
- API frameworks and REST APIs (FastAPI/Django REST or equivalent)
- Automated testing with pytest; strong quality and coverage mindset
- SQL databases: solid knowledge of PostgreSQL and MariaDB (modeling, query writing, migrations, basic performance tuning)
- Data storage: design and operation of data storage solutions, including S3-compatible object storage (Ceph/Rook)
- Docker and Kubernetes: containerization best practices and cluster deployments
- Helm and ArgoCD experience is a significant advantage
- Identity and access management: Keycloak or equivalent SSO/IAM solutions
- Search & analytics: OpenSearch or equivalent
- CI/CD: GitLab CI, deployment automation (Ansible, ArgoCD)
- Linux day-to-day administration and tooling (shell, security, permissions, networking)
- English required
Benefits
- Access to mental health platform nilo including 1on1 sessions
- Access to Udemy training platform with unlimited content and certification
- Support on equipment for remote work
- Flexible working hours
- Regular onsite gatherings, internal initiatives and summer parties
- Paid special leave days
- Workcation possibilities