Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

European Tech Recruit

Senior Data Processing Engineer

Posted Updated

Description

European Tech Recruit in Berlin is seeking a Senior ML Data Processing Engineer to design and optimise large-scale data pipelines for ML training. You will work at the intersection of data engineering, NLP and ML, turning raw web-scale data into high-quality training datasets.

You will implement data quality controls, deduplication, privacy safeguards, and reproducibility measures while collaborating with researchers and engineers to ensure reliable data for advanced model development.

Build and optimise distributed pipelines for large-scale ML training data. Implement data curation, deduplication, filtering and metadata extraction. Develop ML-based evaluators and automated data-quality systems. Establish dataset versioning, lineage and reproducibility. Monitor pipeline performance and data quality; identify bottlenecks. Collaborate with Research, Engineering and Governance on privacy and licensing. PhD in a relevant technical discipline. 3+ years in data processing, ML engineering, NLP or related field. Experience with massive unstructured text datasets and distributed frameworks (Spark, Ray, Flink). Strong Python skills for production-grade pipelines. Experience in data curation, deduplication, filtering, quality datasets. Understanding of data privacy, PII removal and reproducibility. Experience with workflow tools (Airflow, Prefect, Dagster). Experience with LLMs, Docker/Kubernetes, web-scale data acquisition and licensing.

Skills

Apply

See also