Senior Computational AI Architect

You will serve as a strategic advisor for language, reasoning, and evaluation-focused AI programs. Working alongside program managers, AI strategists, and stakeholders, you will provide early-stage guidance on task design, quality standards, multilingual considerations, and evaluation methodologies, helping shape project requirements and quality expectations before execution begins. This is a remote, flexible engagement contributing to frontier AI work.

Responsibilities

• Develop annotation guidelines
• Create reviewer handbooks
• Design evaluator training programs
• Establish escalation frameworks
• Design evaluation rubrics
• Build reasoning-assessment frameworks
• Create multilingual quality standards
• Define quality acceptance criteria
• Review project instructions and identify ambiguity risks
• Improve linguistic consistency
• Guide localization efforts
• Assess evaluator agreement
• Review pilot outputs
• Identify systematic quality issues
• Recommend rubric improvements

Requirements

• Master's or PhD in Computational Linguistics, NLP, Linguistics, or Cognitive Science
• 8+ years of experience
• Expertise across NLP, LLM evaluation, human annotation systems, localization, multilingual AI, and quality frameworks
• Strong written English and the ability to communicate complex ideas clearly
• Comfortable working independently in a remote environment
• Based in the United States