Sr. Software Development Engineer AI/ML, Inference Model Enablement, AWS Neuron
Summary
Optimize and enable state-of-the-art LLMs (dense and MoE) for fast inference on Amazon’s Trainium accelerators using AWS Neuron’s software stack.
Description We develop AWS Neuron, the complete software stack for Trainium, Amazon's custom cloud-scale machine learning accelerators. Join us to optimize the latest models to run really fast on the Trainium hardware. As a Sr. Software Development Engineer on the Inference Model Enablement team, you will onboard and optimize state-of-the-art open-source and customer LLMs, both dense and MoE, for inference on Trainium accelerators. You will also drive improvements in model enablement speed and …