New: Claude Fable 5.2 eval report is here.Read the report ↗

Best LLMs for multi-stage security operations

CyScenarioBench

Tests multi-stage cybersecurity scenarios, helping authorized security teams assess an agent's ability to plan and execute complex assessments. Labs use different private task sets, and safeguards settings are recorded with each report.

Updated: Data as of:
Limited reportingNot saturated
Official benchmark
CyScenarioBench results. Each row identifies its benchmark version and evaluation track. Scores from different versions are not directly comparable. Best effort from the latest stored report date per model and version.
Model / creatorVersionReported score
Claude Mythos 5.2Anthropic · ProprietaryAnthropic 10-challenge subset / prerelease76.3%
Claude Opus 5.5Anthropic · ProprietaryAnthropic 10-challenge subset / prerelease67.6%
Claude Mythos 5.1Anthropic · ProprietaryAnthropic 10-challenge subset / prerelease61.7%
GPT-6 CyberOpenAI · ProprietaryOpenAI GPT-6 Cyber / unique task set61%
View all 4 published reports
Anthropic 10-challenge subset / prerelease

10 private challenges; cyber mitigations off; prerelease snapshot assessed similar to release. Each lab uses different tasks. · Tools enabled

Anthropic ↗
Anthropic 10-challenge subset / prerelease

effort: highest available · safeguards: false · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled

Anthropic ↗
Anthropic 10-challenge subset / prerelease

effort: highest available · safeguards: false · November 9 launch-table comparison; highest available effort unless explicitly noted. Preserve the benchmark track and model configuration; competitor figures are as reported by Anthropic. · Tools enabled

Anthropic ↗
OpenAI GPT-6 Cyber / unique task set

effort: highest available · GPT-6 Cyber: 61%. Labs use unique tasks; not a shared task set with the Anthropic 10-challenge subset. · Tools enabled

Anthropic ↗