GPT-6 Astra (Xhigh); 198-question Diamond subset; independent AA evaluation
Best LLMs for scientific reasoning
GPQA DiamondGPQA Diamond tests graduate-level scientific knowledge and reasoning with difficult multiple-choice questions in biology, chemistry, and physics. Diamond is the 198-question subset selected for high-quality expert agreement. The results here use the independently reported Diamond evaluation.
View all 67 published reports
GPT-6 Astra (Max); 198-question Diamond subset; independent AA evaluation
Gemini 3.8 Flash (High); 198-question Diamond subset; independent AA evaluation
GPT-6 Astra (High); 198-question Diamond subset; independent AA evaluation
GPT-5.6 Sol (Max); 198-question Diamond subset; independent AA evaluation
Muse Spark 1.3 (Xhigh); 198-question Diamond subset; independent AA evaluation
Gemini 3.1 Pro Preview; 198-question Diamond subset; independent AA evaluation
GPT-6 Astra (Medium); 198-question Diamond subset; independent AA evaluation
Claude Opus 5 (High); 198-question Diamond subset; independent AA evaluation
Claude Fable 5.1 (Max, Default Fallback); 198-question Diamond subset; independent AA evaluation
Claude Opus 5 (Xhigh); 198-question Diamond subset; independent AA evaluation
Kimi K3 (Max); 198-question Diamond subset; independent AA evaluation
Muse Spark 1.3 (Max); 198-question Diamond subset; independent AA evaluation
Gemini 3.8 Flash (Medium); 198-question Diamond subset; independent AA evaluation
GPT-5.5 (Xhigh); 198-question Diamond subset; independent AA evaluation
Claude Fable 5.1 (Xhigh, Default Fallback); 198-question Diamond subset; independent AA evaluation
Claude Opus 5 (Max); 198-question Diamond subset; independent AA evaluation
GPT-5.5 (High); 198-question Diamond subset; independent AA evaluation
GPT-5.6 Sol (Xhigh); 198-question Diamond subset; independent AA evaluation
GPT-6 Astra (Low); 198-question Diamond subset; independent AA evaluation
MiniMax-M3; 198-question Diamond subset; independent AA evaluation
GPT-5.6 Sol (High); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Pro 0813 (Max); 198-question Diamond subset; independent AA evaluation
GPT-5.6 Sol (Medium); 198-question Diamond subset; independent AA evaluation
GPT-5.5 (Medium); 198-question Diamond subset; independent AA evaluation
Claude Fable 5 (Max, Opus 4.8 Fallback); 198-question Diamond subset; independent AA evaluation
Gemini 3.8 Flash (Low); 198-question Diamond subset; independent AA evaluation
Claude Opus 4.8 (Max); 198-question Diamond subset; independent AA evaluation
Claude Opus 5 (Medium); 198-question Diamond subset; independent AA evaluation
GLM-5.3 (Max); 198-question Diamond subset; independent AA evaluation
Claude Opus 4.7 (Max); 198-question Diamond subset; independent AA evaluation
GLM-5.3-Flash; 198-question Diamond subset; independent AA evaluation
Kimi K2.6 (Reasoning); 198-question Diamond subset; independent AA evaluation
Claude Sonnet 5 (Max); 198-question Diamond subset; independent AA evaluation
GPT-5.5 (Low); 198-question Diamond subset; independent AA evaluation
Claude Fable 5.1 (High, Default Fallback); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Pro 0424 (High); 198-question Diamond subset; independent AA evaluation
Muse Spark 1.2 (Xhigh); 198-question Diamond subset; independent AA evaluation
Muse Spark 1.1 (Xhigh); 198-question Diamond subset; independent AA evaluation
GPT-5.6 Sol (Low); 198-question Diamond subset; independent AA evaluation
Claude Opus 4.6 (Max); 198-question Diamond subset; independent AA evaluation
GLM-5.2 (Max); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Flash 0420 (Max); 198-question Diamond subset; independent AA evaluation
Claude Opus 5 (Low); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Pro 0424 (Max); 198-question Diamond subset; independent AA evaluation
Claude Fable 5.1 (Medium, Default Fallback); 198-question Diamond subset; independent AA evaluation
Claude Opus 4.7 (Non-reasoning, High); 198-question Diamond subset; independent AA evaluation
Muse Spark; 198-question Diamond subset; independent AA evaluation
Claude Fable 5.1 (Low, Default Fallback); 198-question Diamond subset; independent AA evaluation
Kimi K2.5 (Reasoning); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Flash 0420 (High); 198-question Diamond subset; independent AA evaluation
Kimi K3 (Low); 198-question Diamond subset; independent AA evaluation
Claude Opus 4.6 (Non-reasoning, High); 198-question Diamond subset; independent AA evaluation
Kimi K2 Thinking; 198-question Diamond subset; independent AA evaluation
Claude Sonnet 5 (Non-reasoning, High); 198-question Diamond subset; independent AA evaluation
GPT-5.6 Sol (Non-reasoning); 198-question Diamond subset; independent AA evaluation
Kimi K2.5 (Non-reasoning); 198-question Diamond subset; independent AA evaluation
Kimi K2.6 (Non-reasoning); 198-question Diamond subset; independent AA evaluation
gpt-oss-120b (High); 198-question Diamond subset; independent AA evaluation
GPT-5.5 (Non-reasoning); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Pro 0424 (Non-reasoning); 198-question Diamond subset; independent AA evaluation
DeepSeek V4 Flash 0420 (Non-reasoning); 198-question Diamond subset; independent AA evaluation
DeepSeek R1 (Jan '25); 198-question Diamond subset; independent AA evaluation
gpt-oss-20b (High); 198-question Diamond subset; independent AA evaluation
GLM-5.2 (Non-reasoning); 198-question Diamond subset; independent AA evaluation
gpt-oss-120b (Low); 198-question Diamond subset; independent AA evaluation
gpt-oss-20b (Low); 198-question Diamond subset; independent AA evaluation
