Backend Engineer, AI (Agent Systems)
Posted 67
views
Summary
Backend engineer in Singapore building and operating the production systems behind AI agent features: tuning inference, caching, batching and streaming, and owning monitoring and incident response. Stack includes Python, Node.js, Kubernetes, Docker, PyTorch, SQL/NoSQL and LLM APIs (OpenAI/Anthropic).
Job Scope
- Tune latency and throughput across inference, caching, batching and streaming.
- Take ownership of production operations, including monitoring, logging, alerting and incident response.
- Develop and run backend systems that power AI features in production.
- Design inference pipelines, orchestration layers and service boundaries around models.
Requirements
- Comfortable troubleshooting distributed systems under heavy load.
- Familiarity with AI inference patterns such as LLMs, embeddings and multimodal models.
- Focus on shipping and learning from how systems behave in production.
- Solid backend engineering fundamentals in production environments.
- Experience operating high-throughput, low-latency services.
Tech Stack
- Kubernetes
- OpenAI / Anthropic / open-source LLMs
- Python
- Docker
- SQL & NoSQL
- PyTorch
- Node.js
We regret that only shortlisted candidates will be notified.
GMP Technologies (S) Pte Ltd | EA License: 09C3051 | EA Personnel: Arcus Ang | Registration No: R1985843
Skills
Sign in to read and join the discussion.