a16z AI Engineer
Posted Updated 8
views
Summary
Build and evaluate AI agents for network infrastructure, designing prompts, tools, and metrics to improve agent performance and reliability.
- Build agent evaluation systems
- Collaborate with network domain experts to validate evals
- Create prompts tool descriptions and instructions
- Define quality metrics for end to end tasks
- Develop agent tools and capabilities
- Engineer retrieval prompt and tool result structure
- Improve agent quality with eval driven iteration
- Manage token budgets for large models
- Perform error analysis on real trajectories
