Web Research
Accuracy · Moonshot comparison report
- 01
- 02
- 03
Kimi K3.1 Pro
Across the task benchmarks we track, Kimi K3.1 Pro’s strongest relative results are in web research, knowledge work, and work automations. On BrowseComp, it scores 92.1%, ranking #1 among 3 models with reported results in our dataset.
Updated: Data as of:
🥇
Strongest results
| Benchmark | Measures | Score |
|---|---|---|
| Agent Index ↗v1.2 Preview | Overall agent capability | 67.4 / 100#6 of 26 |
| Terminal-Bench ↗4.0 / mini-swe-agent | Working in a terminal | 67.17%#1 of 56 |
| BrowseComp ↗Published open-model reports | Web research | 92.1%#1 of 8 |
| GDPval-AA ↗2.1 | Knowledge work | 1,858.05 Elo#2 of 38 |
Model details
| Model | Kimi K3.1 Pro |
|---|---|
| Agent Index v1.2 | 67.4 / 100 · Rank 6 · Preview |
| Creator | Moonshot AI (opens in a new tab) |
| Availability | Open source / open weights |
| Context size | 1,000,000 tokens (opens in a new tab) |
| Max output | 1,048,576 tokens (opens in a new tab) |
| Knowledge cutoff | Not reported |
| License | Not reported |
Pricing and performance
Per provider and reported configuration. Prices are USD per 1M tokens.
| Provider / configuration | Contexttokens | InputUSD / 1M tokens | OutputUSD / 1M tokens | LatencyTTFT · seconds | Speedtokens / sec |
|---|---|---|---|---|---|
| Kimi K3.1 Pro | 1,000,000 | $2.00 (opens in a new tab) | $10.00 (opens in a new tab) | 3.427 (opens in a new tab) | 31.249 (opens in a new tab) |
| Kimi K3.1 Pro High Speed | 1,000,000 | $4.00 (opens in a new tab) | $20.00 (opens in a new tab) | 2.683 (opens in a new tab) | 76.93 (opens in a new tab) |
Benchmark performance
Kimi K3.1 Pro in color, alongside leading models. Latest stored reports, best effort per report date.
BrowseComp ↗
Work Automations
Private 657 tasks; 50 turns; objective completion
- 01
- 02
- 03
- 04
- 05
Knowledge Work
220 tasks; Stirrup agent; pairwise Elo
- 01
- 02
- 03
- 04
- 05
Reported benchmarks
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AA-Briefcase1.1 / combined EloCombined Elo · Higher is better | 1,675.78 Elo | selection: best reported configuration per release · Kimi K3.1 Pro · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| AutomationBench-AA1.0.6 / AA private 657Objectives completed without guardrail violations · Higher is better | 73.298% | Kimi K3.1 Pro; Private 657 tasks; 50 turns; objective completion | Artificial Analysis (opens in a new tab)independent |
| AutomationBench-AA1.0.6 / AA private 657Objectives completed without guardrail violations · Higher is better | 73.3% | Artificial Analysis evaluation setup | Artificial Analysis (opens in a new tab)independent |
| BrowseCompKimi K3.1 comparison / 200K compactionAccuracy · Higher is better | 92.1% | 200K context compaction; max 500 steps; temperature 1; top-p 1 | Moonshot AI ↗ (opens in a new tab)provider reported |
| BrowseCompPublished open-model reportsAccuracy · Higher is better | 92.1% | harness comparison: provider-reported; settings differ across models · 200K context compaction; max 500 steps; temperature 1; top-p 1; preserved original track kimi31-report-200k-500steps | Moonshot AI ↗ (opens in a new tab)provider reported |
| GDP.pdf100 tasks / All-pass / five attemptsAccuracy · Higher is better | 31.4% | selection: best reported configuration per release · Kimi K3.1 Pro · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,858.05 Elo | Kimi K3.1 Pro; 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| HLE-Diamond1,000 questions / no toolsAccuracy · Higher is better | 37.3% | selection: best reported configuration per release · Kimi K3.1 Pro · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — full setAccuracy · Higher is better | 51.1% | Max effort; temperature=1.0; top_p=0.95; full 2500-question set. · subset: full · No tools | Moonshot AI ↗ (opens in a new tab)provider reported |
| Humanity's Last ExamStable HLE — full setAccuracy · Higher is better | 70% | Max effort; temperature=1.0; top_p=0.95; full 2500-question set. · subset: full · Tools enabled | Moonshot AI ↗ (opens in a new tab)provider reported |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 52.5% | question count: 2158 · reported precision decimals: 1 · Kimi K3.1 Pro; original HLE; 2,158 text-only questions; no tools; pass@1; chart labels rounded to one decimal. · source model href: /models/kimi-k3-1-pro · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| LiveBench: Agentic2.0 / 2026-10-25Accuracy · Higher is better | 39.1% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: agentic | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Browser Use2.0 / 2026-10-25Accuracy · Higher is better | 75.9% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: browser-use | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Coding2.0 / 2026-10-25Accuracy · Higher is better | 81.8% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: coding | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Data Analysis2.0 / 2026-10-25Accuracy · Higher is better | 79.1% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: data-analysis | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Design2.0 / 2026-10-25Accuracy · Higher is better | 77.8% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: design | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Reasoning2.0 / 2026-10-25Accuracy · Higher is better | 91.1% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: reasoning | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| LiveBench: Research2.0 / 2026-10-25Accuracy · Higher is better | 77.9% | release: 2026-10-25 · Highest supported effort unless publisher reports an exception; single run · suite: research | LiveBench ↗ (opens in a new tab)benchmark publisher · 2026-10-25 |
| Terminal-Bench4.0 / mini-swe-agentTask success · Higher is better | 67.172% | harness: mini-swe-agent · repeats: 3 · selection: best reported configuration per release · Kimi K3.1 Pro | Artificial Analysis (opens in a new tab)independent |
