Applied LLM Systems Engineer
Summary
The Applied LLM Systems Engineer will build and maintain production-grade LLM applications for documentation workflows, focusing on orchestration, evaluation, and system reliability. The role involves collaborating with cross-functional teams to implement retrieval systems, optimize token usage, and ensure auditability.
- Build production grade LLM applications for documentation workflows
- Coordinate with technical writers and engineers to identify AI use cases
- Design evaluation frameworks and regression testing
- Design orchestration for multi step workflows
- Establish observability auditability rollback and safe failure modes
- Implement retrieval structured output and tool integrated systems
- Optimize context management and token usage
- Preserve provenance between source and generated outputs