Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

Cohere

Senior ML Inference Engineer — Model Efficiency

Posted Updated

Description

A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time. Work across the inference stack to improve core performance metrics. Identify bottlenecks and develop innovative optimizations. Collaborate closely with modeling and systems teams. Experiment, measure, and ship improvements to accelerate inference. 5+ years of experience writing high-performance, production-quality code. Strong programming skills in C++ or Python (Rust/Go also welcome). Experience with large language models and the LLM inference ecosystem. Ability to diagnose and resolve performance bottlenecks. A strong bias for action — you ship fast, measure impact, and iterate. Open and inclusive culture Cutting-edge AI research collaboration Weekly lunch stipend Full health and dental benefits Parental Leave top-up for 6 months Personal enrichment benefits Remote-flexible work options 6 weeks of vacation

Skills

Apply

See also