AI Gateway Engineer
Posted Updated
Description
Key Responsibilities
AI Gateway Platform Engineering
- Design and implement enterprise AI Gateway platforms for GenAI, Agentic AI, and LLM workloads.
- Build and manage centralized ingress and egress gateways for AI applications, agents, MCP servers, and external AI services.
- Develop AI traffic routing, model orchestration, load balancing, failover, and request governance capabilities.
- Implement model abstraction layers supporting multiple AI providers including OpenAI, Azure OpenAI, Anthropic, Google Gemini, AWS Bedrock, and private models.
- Design multi-tenant AI platform architectures for enterprise consumption.
- Establish AI service onboarding standards and platform governance processes.
Experience
- 7+ years in Platform Engineering, Cloud Engineering, Security Engineering, or IAM.
- 3+ years in AI/GenAI platform implementation.
- Experience deploying enterprise AI solutions in production environments.
- Strong exposure to secure software development and cloud-native architectures.
Skills
Sign in to read and join the discussion.