AI Product Manager
Summary
Own the AI model relay station and Multi-LLM aggregation platform, routing traffic across providers like OpenAI and DeepSeek while designing billing and permission systems.
Responsibilities
- Lead the planning and evolution of the AI model relay station and Multi-LLM aggregation platform.
- Manage multi-model aggregation and standardization for models like OpenAI, Anthropic, and DeepSeek.
- Design and iterate on intelligent traffic routing strategies, including load balancing, rate limiting, and circuit breaking.
- Build enterprise-level AI permission systems, multi-tenant account systems, and fine‑grained Token metering and billing.
- Coordinate with R&D, QA, and DevOps teams to drive version iterations and optimize throughput and cost structures.
- Track global AI industry trends to transform customer pain points into standardized platform capabilities.
Requirements
- 2-3 years of experience in AI products, LLM platforms, API middle‑end, or high‑performance SaaS platforms.
- Deep understanding of LLM calling chains, API forwarding logic, network protocols, and concurrency control.
- Familiarity with mainstream LLM capabilities, fine‑tuning, RAG, context management, and Prompt engineering.
- Strong logical abstraction and architectural design skills with ability to produce high‑quality PRDs and sequence diagrams.
- Strong ownership, data sensitivity, and project management skills.
Preferred Qualifications
- Experience building AI relay platforms, API distribution platforms, or computing power scheduling centers from 0 to 1.
- Familiarity with LLM adaptation layers, chat interfaces, and Embedding vector interface logic.
- Experience in B2B high‑concurrency SaaS commercial billing and multi‑level permission systems.
- Proficiency with modern full‑stack development tools like Cursor or Claude Code.