Work Automations
Private 657 tasks; 50 turns; objective completion
- 01
- 02
- 03
- 04
- 05
- 44
Claude Sonnet 4.6
Across the task benchmarks we track, Claude Sonnet 4.6’s strongest relative results are in work automations. On AutomationBench-AA, it scores 20.1%, ranking #44 among 55 models with reported results in our dataset.
Updated: Data as of:
Strongest results
| Benchmark | Measures | Score |
|---|---|---|
| GDP.pdf ↗100 tasks / All-pass / five attempts | Professional document reasoning | 15.8%#30 of 55 |
| Humanity's Last Exam ↗Stable HLE — text-only subset | Expert reasoning | 33.6%#45 of 68 |
| AA-Briefcase ↗1.1 / combined Elo | Business deliverables | 1,062 Elo#38 of 57 |
| Terminal-Bench ↗4.0 / mini-swe-agent | Working in a terminal | 3%Joint #40 of 56 |
Model details
| Model | Claude Sonnet 4.6 |
|---|---|
| Agent Index v1.2 | Insufficient coverage (3/7) · Preview |
| Creator | Anthropic (opens in a new tab) |
| Availability | Proprietary |
| Context size | Not reported |
| Max output | Not reported |
| Knowledge cutoff | Not reported |
| License | Not reported |
Pricing and performance
Per provider and reported configuration. Prices are USD per 1M tokens.
No provider pricing or performance reports have been added for this model yet.
Benchmark performance
Claude Sonnet 4.6 in color, alongside leading models. Latest stored reports, best effort per report date.
AutomationBench-AA ↗
Reported benchmarks
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AA-Briefcase1.1 / combined EloCombined Elo · Higher is better | 1,062 Elo | selection: best reported configuration per release · Claude Sonnet 4.6 (max) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| AutomationBench-AA1.0.6 / AA private 657Objectives completed without guardrail violations · Higher is better | 20.1% | reported precision decimals: 1 · result quality: reported · Claude Sonnet 4.6 (max); private held-out 657 tasks; 50 turns; objective completion with zero credit for any guardrail violation. · source model href: /models/claude-sonnet-4-6-adaptive · task count: 657 · Tools enabled · turn cap: 50 | Artificial Analysis (opens in a new tab)independent |
| Gaia2CLI · OpenClaw 2026.4.1Pass@1 · Higher is better | 51.9% | api host: anthropic · capabilities: search, execution, adaptability, ambiguity, time · edition: Gaia2-CLI · harness: OpenClaw 2026.4.1 · reasoning: high · reasoning context: Not specified | Meta Agents Research Environments ↗ (opens in a new tab)benchmark publisher · 2026-04-13 |
| GDP.pdf100 tasks / All-pass / five attemptsAccuracy · Higher is better | 15.8% | selection: best reported configuration per release · Claude Sonnet 4.6 (max) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — full setAccuracy · Higher is better | 46.8% | Sonnet 4.6 comparison; full 2,500-question HLE; no-tools versus tools. · subset: full · Tools enabled | Anthropic ↗ (opens in a new tab)provider reported |
| Humanity's Last ExamStable HLE — full setAccuracy · Higher is better | 34.6% | Sonnet 4.6 comparison; full 2,500-question HLE; no-tools versus tools. · subset: full · No tools | Anthropic ↗ (opens in a new tab)provider reported |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 33.6% | question count: 2158 · reported precision decimals: 1 · Claude Sonnet 4.6 (max); original HLE; 2,158 text-only questions; no tools; pass@1; chart labels rounded to one decimal. · source model href: /models/claude-sonnet-4-6-adaptive · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |
| MyPCBench184 tasks · 100 stepsPerfect-task rate · Higher is better | 50.5% | interface: computer + bash · judge: gemini-3.1-flash-lite-preview · max steps: 100 · rubric score percent: 78.5 · selection: Canonical matched-protocol rows only; four 200-step self-reported rows retained in source snapshot, excluded from this track. · tasks: 184 | MyPCBench / Carnegie Mellon University ↗ (opens in a new tab)benchmark publisher |
| Terminal-Bench4.0 / mini-swe-agentTask success · Higher is better | 3% | harness: mini-swe-agent · repeats: 3 · selection: best reported configuration per release · Claude Sonnet 4.6 (max) | Artificial Analysis (opens in a new tab)independent |