AI Engineer - Malvern, PA
Posted Updated
Description
What you'll do
- Build and debug LangGraph agent workflows.
- Extend the eval harness and run A/B tests between agent and prompt variants.
- Improve prompts with measured, regression-tested changes.
- - Extend human-agent interactive UI.
Required
- LangGraph experience: state graphs, checkpointing, interrupts, tool-calling agents.
- LLM evals: golden sets, LLM-as-judge, A/B comparisons on quality, cost, and latency.
- Robust prompt engineering, including structured outputs.
- Python; Claude on AWS Bedrock a plus.
Nice to have
- Front-end design (JavaScript/TypeScript; Tiptap or Y.js a plus).
- LLM observability (Arize, OpenTelemetry).
- Node.js and AWS.
Skills
Sign in to read and join the discussion.