Prompt Engineer
Summary
Design and maintain prompt frameworks and automated evaluation systems for production-grade LLM applications, optimizing performance through A/B testing.
Key Responsibilities Design, develop, and maintain prompt frameworks, including system prompts, few-shot examples, role-based prompts, and reasoning workflows for production-grade LLM applications. Build and manage automated evaluation frameworks to measure model performance, accuracy, latency, and regression across releases. Conduct structured A/B testing across prompt variations, model versions, and configuration settings to optimize task-specific outcomes. Convert product requirements and ed…