New: Claude Fable 5.2 eval report is here.Read the report ↗

Best LLMs for long-horizon engineering and research

FrontierSWE

Tests substantial engineering and research assignments, helping you assess models for complex client work that extends beyond a quick code change. Each of the 34 tasks has a 20-hour trial budget; scores do not translate directly into billable hours saved.

Updated: Data as of:
Limited reportingNot saturated
Official benchmark
FrontierSWE results. Each row identifies its benchmark version and evaluation track. Scores from different versions are not directly comparable. Best effort from the latest stored report date per model and version.
Model / creatorVersionReported score
Claude Fable 5.2Anthropic · Proprietary2 / Proximal harness69.9%
GPT-6 AstraOpenAI · Proprietary2 / Proximal harness65.5%
Claude Opus 5.5Anthropic · Proprietary2 / Proximal harness62.3%
Gemini 4 CarbonGoogle · Proprietary2 / Proximal harness61.2%
Claude Fable 5.1Anthropic · Proprietary2 / Proximal harness56.3%
View all 5 published reports
2 / Proximal harness

effort: max · Proximal harness; 34 tasks; 20h/trial; mean of five trials. · Tools enabled

Anthropic ↗
2 / Proximal harness

effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled

Anthropic ↗
2 / Proximal harness

effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled

Anthropic ↗
2 / Proximal harness

effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled

Anthropic ↗
2 / Proximal harness

effort: highest available · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled

Anthropic ↗