Senior Software Engineer - Cortex AI - FDE
Posted Updated 3
views
Summary
Design and build agentic runtimes and retrieval systems for AI workflows, optimizing LLM routing, caching, and eval pipelines to productionize scalable AI services.
- Architect agentic runtimes
- Build retrieval augmented generation infrastructure
- Debug requests across services using logs and telemetry
- Develop evals engine pipelines
- Implement scalable context retrieval and indexing
- Improve LLM and agent quality using eval frameworks
- Manage distributed state and robust state management
- Optimize performance and cost for model routing and caching
- Productionize AI workflows into microservices