Prompt Engineer (44445)
Posted Updated
Description
CoolPeople Technology is seeking a Prompt Engineer to shape how AI agents behave in a banking app. You will design system prompts, build evaluation datasets, and measure improvements to LLM applications across markets, with hands-on prompt development using Python and professional English.
You will collaborate with platform engineers, evaluation specialists, product and banking domain teams to ensure grounded, accurate responses and compliant tool usage.
Design and maintain system prompts, agent instructions, routing and handover instructions. Create reusable prompt components and rules for knowledge and tool use. Develop representative evaluation datasets, scoring criteria and regression cases. Perform failure analysis from conversation traces and evaluation results. Test how prompt or model changes affect response quality. Collaborate with platform engineers, evaluation specialists, product and banking domain teams. Hands-on prompt development for LLM applications, incl. production use. Configuring AI agents and evaluating behavior beyond individual examples. System instructions, context management, few-shot examples, tool calling, retrieval, structured outputs and JSON schemas. Inspecting API requests, tool results and conversation traces. Reproducible experiments and clear documentation of changes. Proficiency in Python.Skills
Sign in to read and join the discussion.