Member of Technical Staff
Description
About the Role
Join a small AI infrastructure team working to improve the performance and efficiency of large language model inference. You will contribute across software systems, GPU kernels, and production deployments, helping deliver fast, reliable inference across diverse hardware.
What You'll Do
Bring support for new open-source models to production, tuning them for latency and throughput.
Optimize inference serving, including batching, KV caching, speculative decoding, and quantization.
Write and tune GPU kernels using CUDA, HIP, and Triton across varied hardware platforms.
Design, deploy, and operate heterogeneous compute clusters.
Maintain production inference systems, with a focus on reliability, observability, and cost efficiency.
Work autonomously on technical problems and collaborate with customers and teammates to guide solutions.
What We're Looking For
One to six years of software engineering experience, including systems or low-level engineering close to hardware.
Strong understanding of computer architecture, memory hierarchy, and operating system internals.
Experience with backend, infrastructure, or systems work, as well as familiarity with Python and GPU programming tools such as CUDA or Triton.
Background in machine learning inference optimization or operating large-scale infrastructure, such as clusters or GPU fleets, is valuable.
Evidence of strong technical ownership, rapid learning, and effective problem-solving; customer-facing experience is also useful.
Uses AI agents or coding tools to improve engineering workflows.
Compensation & Benefits
Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.
Location
On-site in San Francisco, California, five days per week.
Skills
As published by ashby · 2 questions
Basics
Name, Email, Resume
Short answers (1)
- LinkedIn Profile URL optional
Pick from a list (1)
- Do you have work authorization for the country this role is based in? optional
Sign in to read and join the discussion.