Terminal Use
Official 4.0 board; native agent harnesses
- 01
- 02
- 03
- 03
- 05
GPT-6.1 Sol
Across the task benchmarks we track, GPT-6.1 Sol’s strongest relative results are in terminal use, work automations, and knowledge work. On Terminal-Bench 4.0, it scores 58.2%, ranking joint #3 among 14 models with reported results in our dataset.
Updated: Data as of:
🥇
Strongest results
| Benchmark | Measures | Score |
|---|---|---|
| Agent Index ↗v1.2 Preview | Overall agent capability | 83.4 / 100#5 of 26 |
| LiveBench: Browser Use ↗2.0 / 2026-10-25 | Browser workflows | 93.3%#1 of 25 |
| GDP.pdf ↗100 tasks / All-pass / five attempts | Professional document reasoning | 32%#2 of 55 |
| LiveBench: Coding ↗2.0 / 2026-10-25 | Coding with LiveBench | 96%Joint #3 of 25 |
Model details
| Model | GPT-6.1 Sol |
|---|---|
| Agent Index v1.2 | 83.4 / 100 · Rank 5 · Preview |
| Creator | OpenAI (opens in a new tab) |
| Availability | Proprietary |
| Context size | 1,000,000 tokens (opens in a new tab) |
| Max output | 128,000 tokens (opens in a new tab) |
| Knowledge cutoff | Not reported |
| License | Not reported |
Pricing and performance
Per provider and reported configuration. Prices are USD per 1M tokens.
| Provider / configuration | Contexttokens | InputUSD / 1M tokens | OutputUSD / 1M tokens | LatencyTTFT · seconds | Speedtokens / sec |
|---|---|---|---|---|---|
| GPT-6.1 Sol (max) | 1,048,576 | $2.00 (opens in a new tab) | $10.00 (opens in a new tab) | 326.239 (opens in a new tab) | 68.704 (opens in a new tab) |
| GPT-6.1 Sol (max) | 1,000,000 | $2.00 (opens in a new tab) | $10.00 (opens in a new tab) | 315.664 (opens in a new tab) | 88.967 (opens in a new tab) |
| GPT-6.1 Sol (max) (Fast) | 1,000,000 | $4.00 (opens in a new tab) | $20.00 (opens in a new tab) | 273.685 (opens in a new tab) | 111.975 (opens in a new tab) |
| GPT-6.1 Sol (max) (Flex) | 1,000,000 | $1.00 (opens in a new tab) | $5.00 (opens in a new tab) | 285.681 (opens in a new tab) | 99.892 (opens in a new tab) |
| GPT-6.1 Sol (max) (Ultrafast) | 1,000,000 | $12.00 (opens in a new tab) | $60.00 (opens in a new tab) | 64.137 (opens in a new tab) | 342.946 (opens in a new tab) |
Benchmark performance
GPT-6.1 Sol in color, alongside leading models. Latest stored reports, best effort per report date.
Terminal-Bench 4.0 ↗
Work Automations
Private 657 tasks; 50 turns; objective completion
- 01
- 02
- 03
- 04
- 05
- 11
Knowledge Work
220 tasks; Stirrup agent; pairwise Elo
- 01
- 02
- 03
- 04
- 05
- 15
Reported benchmarks
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AA-Briefcase1.1 / combined EloCombined Elo · Higher is better | 1,555 Elo | selection: publisher default displayed configuration · GPT-6.1 Sol (max) | Artificial Analysis (opens in a new tab)independent |
| AutomationBench-AA1.0.6 / AA private 657Objectives completed without guardrail violations · Higher is better | 66.6% | reported precision decimals: 1 · result quality: reported · GPT-6.1 Sol (xhigh); private held-out 657 tasks; 50 turns; objective completion with zero credit for any guardrail violation. · source model href: /models/gpt-6-1-sol-xhigh · task count: 657 · Tools enabled · turn cap: 50 | Artificial Analysis (opens in a new tab)independent |
| GDP.pdf100 tasks / All-pass / five attemptsAccuracy · Higher is better | 32% | selection: best reported configuration per release · GPT-6.1 Sol (high) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| GDP.pdf100 tasks / All-pass / five attemptsAccuracy · Higher is better | 31% | selection: publisher default displayed configuration · GPT-6.1 Sol (max) | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,321.98 Elo | GPT-6.1 Sol (Low); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,608.89 Elo | GPT-6.1 Sol (Max); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,459.05 Elo | GPT-6.1 Sol (Medium); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,520.45 Elo | GPT-6.1 Sol (High); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,554.8 Elo | GPT-6.1 Sol (Xhigh); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| HLE-Diamond1,000 questions / no toolsAccuracy · Higher is better | 58.8% | selection: best reported configuration per release · GPT-6.1 Sol (Max) · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 47.359% | GPT-6.1 Sol (Low); 2,158 text-only questions; no tools; original HLE equality checker; GPT-5.6 Luna medium judge · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 52.919% | GPT-6.1 Sol (Max); 2,158 text-only questions; no tools; original HLE equality checker; GPT-5.6 Luna medium judge · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 49.861% | GPT-6.1 Sol (Medium); 2,158 text-only questions; no tools; original HLE equality checker; GPT-5.6 Luna medium judge · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 51.39% | GPT-6.1 Sol (High); 2,158 text-only questions; no tools; original HLE equality checker; GPT-5.6 Luna medium judge · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 52.641% | GPT-6.1 Sol (Xhigh); 2,158 text-only questions; no tools; original HLE equality checker; GPT-5.6 Luna medium judge · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| LiveBench: Agentic2.0 / 2026-10-25Accuracy · Higher is better | 68.7% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: agentic | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Browser Use2.0 / 2026-10-25Accuracy · Higher is better | 93.3% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: browser-use | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Coding2.0 / 2026-10-25Accuracy · Higher is better | 96% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: coding | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Data Analysis2.0 / 2026-10-25Accuracy · Higher is better | 82.7% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: data-analysis | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Design2.0 / 2026-10-25Accuracy · Higher is better | 82.1% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: design | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Reasoning2.0 / 2026-10-25Accuracy · Higher is better | 92.6% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: reasoning | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Research2.0 / 2026-10-25Accuracy · Higher is better | 83.5% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: research | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| Terminal-Bench4.0Task success · Higher is better | 58.2% | Codex; effort=max; 58.2% ± 3.1% | Terminal-Bench ↗ (opens in a new tab)benchmark publisher |
| Terminal-Bench4.0Task success · Higher is better | 58.2% | Codex; max; ±3.1 percentage points | Terminal-Bench ↗ (opens in a new tab)benchmark publisher |
| Terminal-Bench4.0 / mini-swe-agentTask success · Higher is better | 56.061% | harness: mini-swe-agent · repeats: 3 · selection: best reported configuration per release · GPT-6.1 Sol (Max) | Artificial Analysis (opens in a new tab)independent |