Backend AI Inference Engineer
Summary
Backend engineer owning the AI inference and orchestration layer between models and users: building and operating production APIs, designing inference pipelines, monitoring/alerting on incidents, and optimizing latency and throughput using Python, PyTorch, Node.js, SQL/NoSQL, and Docker.
Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.
You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered features, and service boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.
Key Responsibilities:
- Build and operate backend systems serving AI features
- Design inference pipelines and orchestration layers
- Define service boundaries around models
- Monitor, log, alert, and respond to incidents
- Optimize latency and throughput across inference systems
Requirements:
- Experience running high-throughput, low-latency services
- Familiarity with LLMs, embeddings, and multimodal inference
- Experience with Python, NodeJs, and PyTorch
- Knowledge of SQL, noSQL, and Docker
- Bias toward shipping and learning from production behavior
Apply backend engineering expertise across AI inference, orchestration, reliability, latency, and production API performance.
Skills
Sign in to read and join the discussion.