Senior Generative AI Operations (GenAI Ops) Engineer
Posted Updated
Description
EPAM Systems is seeking a GenAI Ops Engineer to build, deploy and sustain the operational infra for large-scale generative AI models across major clouds. You will work with data scientists, ML engineers and software developers to ensure scalable, reliable GenAI services and agent ecosystems.
The role requires strong experience in CI/CD, IaC, container orchestration, and monitoring, with a focus on multi-agent workflows and tool integrations. Fluent English is required.
Build and manage CI/CD pipelines for LLMs and AI agents. Orchestrate multi-agent workflows and A2A communications. Integrate tools via MCP and secure external APIs. Apply IaC across cloud platforms to support GenAI workloads. Monitor, log and optimize model serving and inference. Ensure security, governance and compliance in GenAI infra. 3+ years in a DevOps/SRE/MLOps role focused on cloud infra. Experience deploying and operating LLM inference services. Familiarity with IaC, CI/CD, and container orchestration. Hands-on with tracing/metrics and eval pipelines. Experience with multi-agent workflows and tool integration. Knowledge of guardrails, data security and compliance. Fluent English (B2+). Private health insurance English courses Continuous upskillingSkills
Sign in to read and join the discussion.