Reasoning
198-question Diamond subset; independent AA evaluation
- 01
- 02
- 03
- 03
- 03
- 28
Across the task benchmarks we track, gpt-oss-120b’s strongest relative results are in terminal use, reasoning, and knowledge work. On Terminal-Bench 2.1, it scores 26.2%, ranking #11 among 13 models with reported results in our dataset.
| Benchmark | Measures | Score |
|---|---|---|
| IFBench ↗58 constraint types | Precise instruction following | 68.98%#14 of 17 |
| Terminal-Bench ↗4.0 / mini-swe-agent | Working in a terminal | 0%Joint #49 of 56 |
| Humanity's Last Exam ↗Stable HLE — text-only subset | Expert reasoning | 19.6%#60 of 68 |
| GPQA ↗Diamond / Artificial Analysis | Reasoning | 78.18%#28 of 30 |
| Model | gpt-oss-120b |
|---|---|
| Agent Index v1.2 | Insufficient coverage (4/7) · Preview |
| Creator | OpenAI (opens in a new tab) |
| Availability | Open source / open weights |
| Context size | 131,072 tokens (opens in a new tab) |
| Max output | Not reported |
| Knowledge cutoff | Not reported |
| License | Apache 2.0 · Model weights ↗ (opens in a new tab) |
Per provider and reported configuration. Prices are USD per 1M tokens.
No provider pricing or performance reports have been added for this model yet.
gpt-oss-120b in color, alongside leading models. Latest stored reports, best effort per report date.
198-question Diamond subset; independent AA evaluation
89 tasks; Terminus 2; e2b; three repeats
Private 657 tasks; 50 turns; objective completion
220 tasks; Stirrup agent; pairwise Elo
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AA-Briefcase1.1 / combined EloCombined Elo · Higher is better | 0 Elo | selection: best reported configuration per release · gpt-oss-120b (High) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| AutomationBench-AA1.0.6 / AA private 657Objectives completed without guardrail violations · Higher is better | 0.199% | gpt-oss-120b (High); Private 657 tasks; 50 turns; objective completion | Artificial Analysis (opens in a new tab)independent |
| GDP.pdf100 tasks / All-pass / five attemptsAccuracy · Higher is better | 4% | selection: best reported configuration per release · gpt-oss-120b (High) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 615.64 Elo | gpt-oss-120b (High); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 179.43 Elo | gpt-oss-120b (Low); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GPQADiamond / Artificial AnalysisAccuracy · Higher is better | 78.182% | gpt-oss-120b (High); 198-question Diamond subset; independent AA evaluation | Artificial Analysis (opens in a new tab)independent |
| GPQADiamond / Artificial AnalysisAccuracy · Higher is better | 67.172% | gpt-oss-120b (Low); 198-question Diamond subset; independent AA evaluation | Artificial Analysis (opens in a new tab)independent |
| HLE-Diamond1,000 questions / no toolsAccuracy · Higher is better | 3.8% | selection: best reported configuration per release · gpt-oss-120b (High) · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 19.601% | gpt-oss-120b (High); original HLE text-only 2,158 questions; no tools; not HLE Diamond · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 5.885% | gpt-oss-120b (Low); original HLE text-only 2,158 questions; no tools; not HLE Diamond · No tools | Artificial Analysis (opens in a new tab)independent |
| IFBench58 constraint typesAccuracy · Higher is better | 68.98% | selection: best reported configuration per release · gpt-oss-120b (High) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| Terminal-Bench2.1 / Artificial AnalysisPass@1 · Higher is better | 26.217% | gpt-oss-120b (High); 89 tasks; Terminus 2; e2b; three repeats | Artificial Analysis (opens in a new tab)independent |
| Terminal-Bench2.1 / Artificial AnalysisPass@1 · Higher is better | 13.858% | gpt-oss-120b (Low); 89 tasks; Terminus 2; e2b; three repeats | Artificial Analysis (opens in a new tab)independent |
| Terminal-Bench4.0 / mini-swe-agentTask success · Higher is better | 0% | harness: mini-swe-agent · repeats: 3 · selection: best reported configuration per release · gpt-oss-120b (High) | Artificial Analysis (opens in a new tab)independent |