Software Engineering Director - Inference Platform
Posted 6
views
Summary
Leads the software engineering team for SambaNova's inference platform, building the full-stack software that runs AI inference on the company's RDU (Reconfigurable Dataflow Unit) chips and SambaRack rack-scale hardware, with a focus on agentic workloads like multi-turn agents and code generation.
SambaNova is a leader in next-generation AI infrastructure, delivering a full-stack inference platform for customers worldwide. At the core of SambaNova's technology is the RDU (Reconfigurable Dataflow Unit) — a chip built on a dataflow architecture rather than the traditional GPU model. Its decode performance is especially strong for agentic workloads like multi-turn agents, code generation, and long-running applications. RDUs are packaged into SambaRack, rack-scale hardware that lets customer…