Senior ML Inference Engineer — Model Efficiency
Posted Updated
Description
A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time.
Work across the inference stack to improve core performance metrics.
Identify bottlenecks and develop innovative optimizations.
Collaborate closely with modeling and systems teams.
Experiment, measure, and ship improvements to accelerate inference.
5+ years of experience writing high-performance, production-quality code.
Strong programming skills in C++ or Python (Rust/Go also welcome).
Experience with large language models and the LLM inference ecosystem.
Ability to diagnose and resolve performance bottlenecks.
A strong bias for action — you ship fast, measure impact, and iterate.
Open and inclusive culture
Cutting-edge AI research collaboration
Weekly lunch stipend
Full health and dental benefits
Parental Leave top-up for 6 months
Personal enrichment benefits
Remote-flexible work options
6 weeks of vacation
Skills
Sign in to read and join the discussion.