Skip to content
Search jobs inside your AI agent. Claude, ChatGPT, Claude Code, Codex, Gemini, Cursor and Grok
Connect

EPAM Systems Inc

Senior Backend Engineer: AI Pods & LLM Orchestration

Posted Updated

Description

EPAM Systems is seeking a Senior Backend Developer to join our AI Pods team, building robust AI-powered API services and agentic workflows. You will design backend APIs and orchestration layers, ensuring reliable, secure, and scalable systems across distributed environments.

You will work with Python, AWS, Docker, and modern AI tooling to implement RAG pipelines, integration with LangChain, and end-to-end observability. English proficiency at B2 level or higher is required.

Design and build backend API services and LLM orchestration layers. Own API contracts and service reliability end-to-end. Integrate LLMs with rigorous systems engineering, observability, fallback handling, and cost awareness. Implement and maintain complex RAG pipelines: ingestion, chunking, embedding and retrieval optimization. Develop agent tools using LangChain, LangGraph, and MCP. Build reusable orchestration frameworks for downstream developer consumption. Ensure security, privacy, observability, and test coverage across all backend workflows. Contribute to architecture decisions and engineering standards within the pod. Collaborate with frontend engineers, data engineers, and infrastructure teams. 3+ years of backend experience with microservices and distributed systems. Proficient in Python for high-performance cloud-native APIs. Experience with AWS, Docker, ECS/EKS and RESTful APIs. Strong security practices and IAM/CIAM concepts. English proficiency at B2 level or higher. Healthcare benefits Flexible work arrangements Employee financial programs Paid time off and sick leave Upskilling and certification courses LinkedIn Learning access

Skills

What Senior AI Engineering jobs ask for — and how much of it you have →
Apply

See also

AI Engineering jobs by country — openings, pay and top skills →