Senior DevOps Engineer, AI Platform
Posted Updated
Description
We are seeking a Senior DevOps Engineer to serve as technical lead for our platform's transition, retiring legacy applications cleanly while strengthening MCP Hosting Infra and AI Marketplace. In this role, you will set technical direction, shape how the support bot grows, and raise the bar for the engineers around you.
Responsibilities
- Lead the spin-down of two applications, including migration plans, stakeholder communication, and decommissioning
- Influence the architecture and reliability of MCP Hosting Infra (Kubernetes on AWS), including the gateway and per-user credential handling, by recommending changes that improve the current design
- Guide the evolution of AI Marketplace
- Define the support automation strategy, including which requests the bot resolves, which tools and permissions it gets, and how resolution rate is measured
- Set standards for Terraform, observability, runbooks, and on-call practices
- Review bot escalations for patterns and turn them into prioritized automation work
- Mentor mid-level engineers through code review, design review, and pairing
- Act as the escalation point for complex incidents and cross-team requests
- Partner with product and other teams to prioritize work and set expectations
Requirements
- 3+ years of experience in DevOps or Site Reliability Engineering
- Track record of leading technical work end to end, including migrations or decommissions
- Expertise in AWS, Terraform, and Amazon Elastic Kubernetes Service, with strong Kubernetes experience strongly preferred
- Background in monitoring and observability practices
- Experience designing authentication or credential-management systems using OAuth2, or operating them at scale
- Experience designing on-call and support processes, not just participating in them
- Demonstrated ability to mentor and to make pragmatic trade-offs
- Proficiency in English at a B2+ level
Nice to have
- Familiarity with Model Context Protocol
- Skills in Python and TypeScript
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn