Senior Backend Engineer - LLM & Distributed Systems
Summary
Senior Backend Engineer at Aleroy, building a unified platform for high-performance AI inference. The role owns core backend service architecture, building distributed systems and LLM-serving APIs in Go, Node.js/TypeScript, and Python — including OpenAI-compatible APIs, SSE/WebSocket token streaming, and multi-tenant routing, caching, and scaling.
Aleroy is building a unified platform for high-performance AI inference. We are seeking a Senior Backend Engineer to own the architecture of core backend services and deliver end-to-end features.
You will work hands-on across Go, TypeScript/JavaScript (Node.js), and Python, building distributed systems, LLM-serving APIs, and robust data/storage layers. You will design OpenAI-compatible APIs, implement token streaming via SSE/WebSockets, and manage routing, caching, and scaling for multi-tenant
