OpenAI Releases MentalHealthBench With 1,215 Conversations From 80+ Psychologists in 22 Countries
Summary
OpenAI released MentalHealthBench, a public benchmark of 1,215 synthetic mental-health conversations paired with 5,262 rubric criteria co-written by 80+ licensed psychologists and psychiatrists across 22 countries and 19 languages. Coverage splits 53.5% non-acute, 18.2% high-acuity and 28.3% emergency. GPT-6 Astra scores 57.3%, ahead of GPT-6 Sol (53.9%), Claude Opus 5.5 (52.4%), GPT-6 Luna (50.2%), and well above GPT-4o (32.1%) and Gemini 2.5 Pro (29.5%).
Shared on Bluesky by 1 AI expert
Originally reported by openai.com
Read the original article →Original headline: OpenAI Releases MentalHealthBench With 1,215 Conversations From 80+ Psychologists in 22 Countries