Staff Software Engineer Core AI Platforms
Summary
Build and operate core AI platforms, including multi-agent orchestration, evaluation frameworks, and observability, while scaling Ruby on Rails and React apps and mentoring engineers.
You build and operate foundational AI platform systems, including multi-agent orchestration, tool registries, agent handoffs, human escalation, conversation state, evaluation frameworks, and observability. You also develop reliable backend services and internal APIs, scale Ruby on Rails and React applications, mentor engineers, and enable product teams to deliver AI capabilities safely.
Responsibilities
- Design evaluation frameworks
- Build golden datasets
- Implement LLM-as-judge pipelines
- Establish regression gates
- Implement observability and tracing
- Design core platform services
- Build core platform services
- Test core platform services
- Mentor engineers
- Scale Ruby on Rails and JavaScript applications
- Collaborate with product, management, data, and design teams
- Build internal platforms and APIs
Requirements
- 8+ years of software development experience
- Production AI and LLM experience
- Agent orchestration
- Tool integration
- Retrieval
- Evaluation and feedback loops
- AI coding assistants
- AI frameworks
- Ruby on Rails
- JavaScript
- React
- Testing
- Communication
Benefits
- equity (RSUs)