Senior ML Engineer: Low-Latency Orchestration (Remote)
Posted Updated
Description
MyChatBot is seeking an experienced ML engineer to own the model serving and orchestration layer in a remote EU setup. You will optimize latency, cost and quality across providers including OpenAI and Anthropic, and build evaluation harnesses with A/B testing to drive improvements in RAG and tool-use.
The role requires deep Python expertise, 5+ years in ML engineering, and 2+ years on production LLM systems.
Own the model serving and orchestration layer. Optimize for latency, cost and quality across providers (OpenAI, Anthropic, in-house). Build evaluation harnesses and A/B testing infrastructure. Research and ship improvements to RAG, tool-use and multi-step reasoning. Mentor other engineers on ML best practices. 5+ years of ML engineering experience. 2+ years production LLM systems. Strong Python expertise. Familiar with latency optimization and cost tradeoffs. Remote-first Equity package Health insurance $2k learning budget Compute budget for experimentsSkills
Sign in to read and join the discussion.