Senior ML Engineer, AI Health Orchestration & Safe LLMs
Posted Updated 8
views
Who recruits here
Up to three recruiters at Doctolib with their work email, so you can write to a person.
Available on Pro.
Description
Doctolib is seeking a Senior Machine Learning Engineer to join the Orchestration team within the AI Health Assistant initiative. You will shape how our AI Health Companion evaluates safety, reliability, and usefulness for patients and clinicians.
You will build robust evaluation pipelines, run experiments on reasoning and alignment, and collaborate with researchers to push practical, safe AI in healthcare. Hybrid in Paris area with strong technical stack.
Define and own the evaluation strategy for our AI agentic system—metrics, protocols, datasets, and tooling. Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment. Run systematic experiments to assess reasoning, factuality, robustness, and user experience. Collaborate closely with model developers and researchers to provide insights and drive iterations. Contribute to research and knowledge sharing on LLM evaluation methodologies. Must hold MSc or PhD in Computer Science, ML, DS, or related field. 7+ years of hands-on experience with large language models (GPT, Claude, Llama, BERT-like). Proven experience evaluating agentic or reasoning systems and automating evaluations. Strong experiment design, metrics definition, and evaluation automation skills. Ability to bridge research and production to influence modeling and product decisions. Excellent communication, collaboration, and English fluency. Health insurance for you and family 25 days paid vacation + RTT Lunch vouchers (Swile)Skills
Sign in to read and join the discussion.