effort: max · Proximal harness; 34 tasks; 20h/trial; mean of five trials. · Tools enabled
Anthropic ↗Best LLMs for long-horizon engineering and research
FrontierSWETests substantial engineering and research assignments, helping you assess models for complex client work that extends beyond a quick code change. Each of the 34 tasks has a 20-hour trial budget; scores do not translate directly into billable hours saved.
| Model / creator | Version | Reported score |
|---|---|---|
| 2 / Proximal harness | 69.9% | |
| 2 / Proximal harness | 65.5% | |
| 2 / Proximal harness | 62.3% | |
| 2 / Proximal harness | 61.2% | |
| 2 / Proximal harness | 56.3% |
View all 5 published reports
effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled
Anthropic ↗effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled
Anthropic ↗effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled
Anthropic ↗effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled
Anthropic ↗