AI Platform Architect
Posted Updated
Description
As our AI Platform Architect, you will report directly to the CPTO and own the core foundation Rithm runs on. Your mandate is to make our AI platform dependable at scale, run our cloud infrastructure like a product, and build an agentic development factory that gives a senior engineering team massive leverage.
Key Responsibilities:
- Architect high-volume AI pipelines processing millions of enterprise contracts and business documents.
- Build model routing, caching layers, and real-time evaluation gates.
- Ensure durable, observable agent execution and manage end-to-end agent/prompt lifecycles.
- Drive the architecture for the Agentic AI App Studio.
- Lead multi-tenant cloud releases and Infrastructure as Code (IaC).
- Define SLOs, full-stack observability (OpenTelemetry, Prometheus, Grafana), and robust incident practice.
- Drive AI FinOps to govern token, GPU, and cloud spend while enforcing enterprise security, compliance, and auditable, explainable AI outputs.
- Design an agentic SDLC where senior engineers and AI agents build and ship safely together with human checkpoints.
- Establish golden paths, automated CI/CD pipelines, and rigorous regression eval harnesses.
- Continuously scale engineering throughput while maintaining an uncompromising quality bar.
What You Bring:
- 12+ years of overall software engineering experience, with 4+ years architecting scalable cloud platforms (Kubernetes, IaC).
- Hands-on production experience with LLM systems: document AI, RAG / Vectorless RAG, evals, agentic frameworks, and MCP (Model Context Protocol).
- Proven track record with ontology- and knowledge-graph-driven hybrid AI (combining LLMs with deterministic enterprise APIs).
- Direct integration experience connecting AI layers to enterprise systems (ERP, CRM, finance) via APIs and MCP.
- Demonstrated history of taking complex platform architectures from fragile prototypes to enterprise-grade, dependable production systems.
- Hands-on builder mindset who actively uses and ships with AI coding agents daily.
Our Values (T. R. U. S. T):
- Transparent - We work in the open.
- Respect - For people and promises.
- Uncompromising - On quality and security.
- Speed - Ship, learn, iterate.
- Teamwork - People and agents, one team.
Skills
Sign in to read and join the discussion.