First VP, GenAI Engineer/Scientist Lead, Innovation Group
Posted Updated 13
views
Summary
Lead GenAI agent operations in a banking environment, focusing on prompt engineering, agent lifecycle management, and integrating AI workflows into IT service management processes like incident and change management. Core tech involves GenAI, LLM agents, and prompt optimization.
- Align prompt tuning with ethical guidelines
- Apply agent evaluation frameworks
- Automate service operations improvements
- Craft optimize prompts system messages few shot examples
- Define agent roadmaps
- Develop SOPs FAQs user guides
- Fine tune prompts for accuracy relevance cost efficiency
- Implement agent workflows into incidents problems change management
- Implement corrective actions
- Maintain logging audit trails reporting
- Manage agent lifecycle onboarding configuration retirement
- Monitor agent performance uptime compliance
- Monitor latency token usage output quality
- Perform root cause analysis for service operations
- Refine prompts and pipelines using metrics
- Triage and resolve agent related incidents
- Update prompts and roadmap based on regulatory policy changes