freehire launches on Product Hunt on 26 August.

Follow →

Psychiatry Specialist (Contract)

Open 42d

Summary

Psychiatrists evaluate and improve AI language models by designing challenging clinical scenarios and assessing how models handle complex psychiatric cases, providing structured feedback to advance healthcare AI reliability. This contract role involves creating diagnostic and treatment scenarios, scoring AI responses for accuracy and safety, and collaborating with AI researchers to identify model

About mpathic.ai

mpathic is keeping humans safe in the AI era through automated tools and expert datasets that are rooted in psychology and powered by clinicians.

We are a series A start-up backed by Tier 1 investors including Foundry.vc and Next Frontier Capital.


If you have applied for an expert role within the past 12 months, you do not need to reapply.


About the role

We're looking for experienced psychiatrists to help evaluate and improve the next generation of large language models by testing how they reason through complex psychiatric cases. In this role, you'll create challenging, clinically realistic scenarios that push AI beyond straightforward textbook knowledge. You'll identify where models break down, develop expert reference answers grounded in evidence-based psychiatric practice, and provide structured feedback that directly improves model performance. Your expertise will help shape safer, more reliable AI for healthcare.


What You'll Do

  • Design clinically realistic prompts and case scenarios based on your psychiatry practice, including diagnostic formulation, medication management, psychotherapy, risk assessment, capacity evaluation, and complex clinical decision-making.
  • Evaluate AI-generated responses using structured rubrics for accuracy, safety, completeness, and clinical judgment.
  • Identify nuanced edge cases, challenging differential diagnoses, and common model failure modes to improve AI reasoning.
  • Collaborate with researchers at a leading AI lab to advance the performance and reliability of healthcare AI systems.
  • Provide detailed written feedback that informs future model training and evaluation.
  • Participate in onboarding, calibration sessions, and ongoing quality reviews.


Qualifications

  • MD, DO, or internationally equivalent medical degree.
  • Completion of an accredited psychiatry residency (ACGME, AOA, or recognized international equivalent).
  • Current board certification in Psychiatry (ABPN, FRCPC, MRCPsych, FRANZCP, or recognized national equivalent).
  • Current, active, unrestricted medical license with no suspension, revocation, or ongoing disciplinary action.
  • At least 3 years of independent clinical practice following residency (training years excluded), either currently practicing or having practiced within the past two years.
  • Experience practicing in an accredited or government-licensed healthcare setting, including hospitals, academic medical centers, community mental health clinics, private practice, or telepsychiatry.


Nice to have

  • Currently providing at least 10 hours of direct patient care per week.
  • Advanced expertise in Addiction Psychiatry, Child & Adolescent Psychiatry, Consultation-Liaison Psychiatry, Forensic Psychiatry, Geriatric Psychiatry, or another recognized psychiatry subspecialty through fellowship training, subspecialty board certification, or at least two years of focused clinical practice.
  • Experience developing or examining Objective Structured Clinical Examinations (OSCEs).
  • Passion for improving AI systems and advancing the future of responsible healthcare technology.


Compensation

This is a contract, project-based position. The hourly rate will depend on experience and project parameters. The rate will be disclosed prior to starting the project.


IMPORTANT - How to Apply

We can only accept and review and applications via our direct official recruiting portal: https://mpathic2.bamboohr.com/careers, due to the abundance of 3rd party apps and automated agents. Only applications submitted directly by the applicant through our portal will be considered.

See also

Tailor your CV for this role?

We couldn't check your fit for this role — add a CV to your profile to see it next time.

A new version of freehire is available