VP / AVP, GenAI Engineer/Scientist, Innovation Group
Posted Updated 14
views
Summary
Manage GenAI agent lifecycles—onboarding, configuration, retirement—and fine-tune prompts for cost and accuracy while monitoring performance, SLA compliance, and incident triage within a bank's innovation group.
- Apply evaluation frameworks for agent performance reliability compliance
- Conduct root cause analysis and automation for service improvement
- Coordinate incident problem and change integration
- Define agent roadmaps
- Develop SOPs FAQs and user guides
- Ensure logging audit trails and reporting
- Fine tune prompts and system messages with few shot examples
- Manage agent lifecycle onboarding configuration retirement
- Monitor agent performance uptime and SLA compliance
- Monitor latency token usage and output quality
- Optimize prompt tuning for cost and accuracy
- Run agent issue triage and resolution