freehire launches on Product Hunt on 26 August.

Follow →

Backend Engineer

Open 1d

Summary

Builds and optimizes backend systems that serve AI-powered features, focusing on inference pipelines, orchestration, and low-latency performance for real-world AI interactions.

Our client is building AI systems that work in the real world. They need a Backend Engineer who owns the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.

What You’ll Own

  • Backend systems that serve AI‑powered features in production
  • Inference pipelines, orchestration layers, and service boundaries around models
  • Production concerns: monitoring, logging, alerting, and incident response
  • Latency and throughput optimisation across inference, caching, batching, and streaming

What They’re Looking For

  • Strong backend engineering fundamentals in production environments
  • Experience running high‑throughput, low‑latency services
  • Familiarity with AI inference patterns (LLMs, embeddings, multimodal)
  • Comfortable debugging distributed systems under load
  • Bias toward shipping and learning from production behaviour

Technical Stack

Python, Node.js, PyTorch, OpenAI / Anthropic / OSS LLMs, SQL & NoSQL, Kubernetes, Docker

Environment

Small team. World‑class talent density. Fast decisions, collective ownership, and a relentless focus on shipping quality work. You’ll need to bring structure, exercise judgment, and execute independently.

We encourage applicants from all backgrounds, so if there is anything we can do to make our recruitment processes better for you and to allow you to show your best self, let us know. We also understand that some people require extra time to complete assessments, require alternative application methods and can also benefit from having interview questions or a guide to the type of questions pre‑interview. We are open to any suggestions or requests that you may have and are always looking for creative ways to assess talent. Our commitment to you is that you should always feel safe and secure when you’re working with us.

See also