New: Agent Index for knowledge work is live.Explore the index ↗

Best LLMs for scientific reasoning

GPQA Diamond

GPQA Diamond tests graduate-level scientific knowledge and reasoning with difficult multiple-choice questions in biology, chemistry, and physics. Diamond is the 198-question subset selected for high-quality expert agreement. The results here use the independently reported Diamond evaluation.

Updated: Data as of:
Widely usedSaturated
Official benchmark
GPQA Diamond results. Each row identifies its benchmark version and evaluation track. Scores from different versions are not directly comparable. Best effort from the latest stored report date per model and version.
Model / creatorVersionReported score
GPT-6 AstraOpenAI · ProprietaryDiamond96.263%
Gemini 3.8 FlashGoogle · ProprietaryDiamond95.253%
Gemini 3.1 ProGoogle · ProprietaryDiamond94.141%
GPT-5.6 SolOpenAI · ProprietaryDiamond94.141%
Muse Spark 1.3Meta · ProprietaryDiamond94.141%
Claude Fable 5.1Anthropic · ProprietaryDiamond93.737%
Claude Opus 5Anthropic · ProprietaryDiamond93.737%
GPT-5.5OpenAI · ProprietaryDiamond93.535%
Kimi K3Moonshot AI · Open source / open weightsDiamond93.535%
MiniMax M3MiniMax · Open source / open weightsDiamond92.929%
DeepSeek V4 Pro 0813DeepSeek · Open source / open weightsDiamond92.828%
Claude Fable 5Anthropic · ProprietaryDiamond92.626%
Claude Opus 4.8Anthropic · ProprietaryDiamond92.02%
GLM-5.3Z.ai · Open source / open weightsDiamond91.717%
Claude Opus 4.7Anthropic · ProprietaryDiamond91.414%
GLM-5.3-FlashZ.ai · Open source / open weightsDiamond91.212%
Claude Sonnet 5Anthropic · ProprietaryDiamond91.111%
Kimi K2.6Moonshot AI · Open source / open weightsDiamond91.111%
DeepSeek V4 Pro 0424DeepSeek · Open source / open weightsDiamond90.505%
Muse Spark 1.2Meta · ProprietaryDiamond90.404%
Muse Spark 1.1Meta · ProprietaryDiamond89.798%
Claude Opus 4.6Anthropic · ProprietaryDiamond89.596%
GLM-5.2Z.ai · Open source / open weightsDiamond89.495%
DeepSeek V4 Flash 0420DeepSeek · Open source / open weightsDiamond89.394%
Muse SparkMeta · ProprietaryDiamond88.384%
Kimi K2.5Moonshot AI · Open source / open weightsDiamond87.879%
Kimi K2 ThinkingMoonshot AI · Open source / open weightsDiamond83.838%
gpt-oss-120bOpenAI · Open source / open weightsDiamond78.182%
DeepSeek R1 (Jan 2025)DeepSeek · Open source / open weightsDiamond70.808%
gpt-oss-20bOpenAI · Open source / open weightsDiamond68.788%
View all 67 published reports
Diamond

GPT-6 Astra (Xhigh); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-6 Astra (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Gemini 3.8 Flash (High); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-6 Astra (High); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-5.6 Sol (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Muse Spark 1.3 (Xhigh); 198-question Diamond subset; independent AA evaluation

Diamond

Gemini 3.1 Pro Preview; 198-question Diamond subset; independent AA evaluation

Diamond

GPT-6 Astra (Medium); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 5 (High); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Fable 5.1 (Max, Default Fallback); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 5 (Xhigh); 198-question Diamond subset; independent AA evaluation

Kimi K393.535%
Diamond

Kimi K3 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Muse Spark 1.3 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Gemini 3.8 Flash (Medium); 198-question Diamond subset; independent AA evaluation

GPT-5.593.535%
Diamond

GPT-5.5 (Xhigh); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Fable 5.1 (Xhigh, Default Fallback); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 5 (Max); 198-question Diamond subset; independent AA evaluation

GPT-5.593.232%
Diamond

GPT-5.5 (High); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-5.6 Sol (Xhigh); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-6 Astra (Low); 198-question Diamond subset; independent AA evaluation

MiniMax M392.929%
Diamond

MiniMax-M3; 198-question Diamond subset; independent AA evaluation

Diamond

GPT-5.6 Sol (High); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Pro 0813 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-5.6 Sol (Medium); 198-question Diamond subset; independent AA evaluation

GPT-5.592.626%
Diamond

GPT-5.5 (Medium); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Fable 5 (Max, Opus 4.8 Fallback); 198-question Diamond subset; independent AA evaluation

Diamond

Gemini 3.8 Flash (Low); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 4.8 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 5 (Medium); 198-question Diamond subset; independent AA evaluation

GLM-5.391.717%
Diamond

GLM-5.3 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 4.7 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

GLM-5.3-Flash; 198-question Diamond subset; independent AA evaluation

Kimi K2.691.111%
Diamond

Kimi K2.6 (Reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Sonnet 5 (Max); 198-question Diamond subset; independent AA evaluation

GPT-5.591.01%
Diamond

GPT-5.5 (Low); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Fable 5.1 (High, Default Fallback); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Pro 0424 (High); 198-question Diamond subset; independent AA evaluation

Diamond

Muse Spark 1.2 (Xhigh); 198-question Diamond subset; independent AA evaluation

Diamond

Muse Spark 1.1 (Xhigh); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-5.6 Sol (Low); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 4.6 (Max); 198-question Diamond subset; independent AA evaluation

GLM-5.289.495%
Diamond

GLM-5.2 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Flash 0420 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 5 (Low); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Pro 0424 (Max); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Fable 5.1 (Medium, Default Fallback); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 4.7 (Non-reasoning, High); 198-question Diamond subset; independent AA evaluation

Muse Spark88.384%
Diamond

Muse Spark; 198-question Diamond subset; independent AA evaluation

Diamond

Claude Fable 5.1 (Low, Default Fallback); 198-question Diamond subset; independent AA evaluation

Kimi K2.587.879%
Diamond

Kimi K2.5 (Reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Flash 0420 (High); 198-question Diamond subset; independent AA evaluation

Kimi K384.242%
Diamond

Kimi K3 (Low); 198-question Diamond subset; independent AA evaluation

Diamond

Claude Opus 4.6 (Non-reasoning, High); 198-question Diamond subset; independent AA evaluation

Diamond

Kimi K2 Thinking; 198-question Diamond subset; independent AA evaluation

Diamond

Claude Sonnet 5 (Non-reasoning, High); 198-question Diamond subset; independent AA evaluation

Diamond

GPT-5.6 Sol (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Kimi K2.578.889%
Diamond

Kimi K2.5 (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Kimi K2.678.788%
Diamond

Kimi K2.6 (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

gpt-oss-120b (High); 198-question Diamond subset; independent AA evaluation

GPT-5.576.768%
Diamond

GPT-5.5 (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Pro 0424 (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek V4 Flash 0420 (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

DeepSeek R1 (Jan '25); 198-question Diamond subset; independent AA evaluation

Diamond

gpt-oss-20b (High); 198-question Diamond subset; independent AA evaluation

GLM-5.268.586%
Diamond

GLM-5.2 (Non-reasoning); 198-question Diamond subset; independent AA evaluation

Diamond

gpt-oss-120b (Low); 198-question Diamond subset; independent AA evaluation

Diamond

gpt-oss-20b (Low); 198-question Diamond subset; independent AA evaluation