Big Data & Backend Engineer – Spatial ETL (m/f/d)
Summary
Engineer for Project IRIS, building high-performance spatial ETL pipelines that download and process massive public data dumps (corporate registers, PRTR, energy grids) into a central PostgreSQL/PostGIS architecture, with Docker-based ingestion and idempotent multi-million-row weekly updates. Core stack: Python (SQLAlchemy, Pandas), PostgreSQL, PostGIS, Docker.
Big Data & Backend Engineer – Spatial ETL (m/f/d)
Location: Germany (Hybrid / Remote options available)
Contract Type: Full-Time Employment (Permanent)
Target Group: Backend Engineers, Data Engineers, Database Administrators, Opportunity Card Holders, and Master's Graduates
About Project IRIS Project IRIS is a proprietary applied research initiative processing massive amounts of infrastructure and spatial data. We bridge the gap between fragmented public data and actionable infrastructure intelligence. When standard APIs reach their limits and entire national registries must be processed, you step in. In this role, you are the architect for heavy data loads and robust backend pipelines.
Your Focus & Responsibilities
- Bulk Processing: Automate the download and processing of massive data dumps (e.g., corporate registers, industrial emission databases like PRTR, energy grids).
- ETL Engineering: Program high-performance ETL pipelines that decompress, parse, and transfer complex archives into our central PostgreSQL architecture.
- Database Governance: Ensure idempotency, deduplication, and reliable monitoring during weekly multi-million row updates.
- Container Orchestration: Deploy and maintain isolated Docker environments for all ingestion tasks.
What We Are Looking For
- Technical Background: Degree in Computer Science, Software Engineering, or extensive practical backend industry experience.
- Core Technical Skills: Expertise in processing relational mass data, strong Python skills (SQLAlchemy, Pandas), and deep PostgreSQL performance tuning.
- Mindset: A clean-code engineering approach focused on system stability and scalability.
- Eligibility: Open to local applicants and international candidates (Chancenkarte / Opportunity Card supported).
- Languages: Professional working proficiency in English (required); German language skills are a plus.
What We Offer
- Full-Time Permanent Employment: Long-term career stability with clear growth trajectories.
- Dual Master / Trainee Track Available: Tailored tracks including academic coordination and complete tuition support.
- Accommodation & Onboarding Package: Structured assistance with local accommodation, official registration, and comprehensive onboarding.
- Visa & Administrative Backing: Dedicated employer support for Opportunity Card conversions and visa applications.
- Modern Tech Environment: Work in a high-efficiency environment centered on Python, PostGIS, and Docker.
How to Apply: Send your CV by E-Mail:
jobs-trainee@iris-institut.org (Subject: Application - Big Data & Backend Engineer)