New: Claude Fable 5.2 eval report is here.Read the report ↗

Explore SWE-2 Flash’s published benchmark results and provider offerings below. More comparable task results are needed to describe its strongest areas.

Updated: Data as of:

Reported highlights

Published scores for SWE-2 Flash; no comparative rank is assigned
BenchmarkMeasuresScore
DeepSWE ↗v1.1Coding agents60.1% (opens in a new tab)
Terminal-Bench ↗2.1 / Cognition SWE-2 Flash launchWorking in a terminal89.2% (opens in a new tab)

Model details

Proprietary3 benchmarks
Specifications for SWE-2 Flash
ModelSWE-2 Flash
Agent Index v1.3Insufficient coverage (0/7) · Preview
CreatorCognition (opens in a new tab)
AvailabilityProprietary
Context sizeNot reported
Max outputNot reported
Knowledge cutoffNot reported
LicenseNot reported

Pricing and performance

Per provider and reported configuration. Prices are USD per 1M tokens.

No provider pricing or performance reports have been added for this model yet.

Blended token cost

USD per 1M tokens · 50% input + 50% output · lower is better

No sourced current price for SWE-2 Flash.10 of 45 priced models selected
Pricing details and sources

Blended cost = (input price + output price) ÷ 2: 500,000 input and 500,000 output tokens. Each model uses its lowest sourced current provider rate, excluding batch and Flex tiers. Cache discounts, tool fees and workload-specific token usage are excluded. 52 models without complete sourced current prices are unavailable in this comparison. The default selection is this model and the nine closest in blended cost; if this model has no price, we show the ten cheapest. The scale stays fixed across pages of your selection.

Pricing sources for selected models
ModelInput / 1MOutput / 1MBlended / 1MProvider / source
DeepSeek V4.1 Flash 1017$0.098$0.294$0.196DeepInfraDeepSeek V4.1 Flash 1017 (max) · Checked 2026-11-02
DeepSeek V4.1 Flash$0.14$0.42$0.28DeepInfraDeepSeek V4.1 Flash (max) · Checked 2026-11-02
Claude Haiku 5.5$0.10$0.50$0.30Anthropic ↗Standard API, prompts up to 100K input tokens · Checked 2026-11-02
GPT-6 Luna$0.10$0.50$0.30OpenAI ↗Standard API, prompts up to 272K input tokens · Checked 2026-11-02
GLM-5.3-Flash$0.15$0.50$0.325Z.aiGLM-5.3-Flash · Checked 2026-11-02
MiniMax M3.1 Flash$0.143$0.57$0.356GMIMiniMax-M3.1-Flash · Checked 2026-11-02
GLM-5.3$0.20$0.64$0.42Multiverse ComputingGLM-5.3 (max) · Checked 2026-11-02
MiMo-V2.6-Pro$0.435$0.87$0.653Xiaomi ↗Standard API, USD, uncached input · Checked 2026-11-02
MiniMax M3$0.30$1.20$0.75MiniMaxMiniMax-M3 · Checked 2026-11-02
DeepSeek V4 Pro 0813$0.50$2.00$1.25SystalyzeDeepSeek V4 Pro 0813 (max) · Checked 2026-11-02

Output speed

Output tokens per second · higher is better

No sourced output speed for SWE-2 Flash.10 of 33 models with reports selected
Measurement details and sources

Output speed measures generated tokens per second. Each model uses its fastest sourced current provider report. Batch and Flex tiers are excluded. Provider, configuration, prompt and reporting methods can differ, so these are reported observations rather than controlled head-to-head tests. 64 models have no qualifying sourced speed report. Defaults include this model and the nine closest reported values, or the ten leading models if this model has no report. The scale stays fixed across selected pages.

Output speed sources for selected models
ModelOutput speedProvider / configurationMeasurementSource
DeepSeek V4.1 Flash 10171,075.275 t/sInco (FAST)DeepSeek V4.1 Flash 1017 (max) (FAST)longmedianArtificial Analysis: DeepSeek V4.1 Flash 1017 (max) (FAST); host Inco (FAST); standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
DeepSeek V4.1 Flash830.034 t/sBaseten (FAST)DeepSeek V4.1 Flash (max) (FAST)longmedianArtificial Analysis: DeepSeek V4.1 Flash (max) (FAST); host Baseten (FAST); standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
MiniMax M3.1 Flash812.597 t/sIncoMiniMax-M3.1-FlashlongmedianArtificial Analysis: MiniMax-M3.1-Flash; host Inco; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
GLM-5.3688.217 t/sSystalyzeGLM-5.3 (max)longmedianArtificial Analysis: GLM-5.3 (max); host Systalyze; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
Kimi K3481.694 t/sInco (FAST)Kimi K3 (max) (FAST)longmedianArtificial Analysis: Kimi K3 (max) (FAST); host Inco (FAST); standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
GPT-6.1 Sol342.946 t/sOpenAI (Ultrafast)GPT-6.1 Sol (max) (Ultrafast)longmedianArtificial Analysis: GPT-6.1 Sol (max) (Ultrafast); host OpenAI (Ultrafast); standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
DeepSeek V4 Pro 0813305.002 t/sSystalyzeDeepSeek V4 Pro 0813 (max)longmedianArtificial Analysis: DeepSeek V4 Pro 0813 (max); host Systalyze; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
Muse Spark 1.1294.835 t/sMetaMuse Spark 1.1 (xhigh)longmedianArtificial Analysis: Muse Spark 1.1 (xhigh); host Meta; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
Muse Spark 1.2277.574 t/sMetaMuse Spark 1.2 (xhigh)longmedianArtificial Analysis: Muse Spark 1.2 (xhigh); host Meta; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
Muse Spark 1.3195.207 t/sMetaMuse Spark 1.3 (max)longmedianArtificial Analysis: Muse Spark 1.3 (max); host Meta; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02

Latency

Time to first token in seconds · lower is better

No sourced time-to-first-token latency for SWE-2 Flash.10 of 32 models with reports selected
Measurement details and sources

Latency measures time to first token (TTFT), converted to seconds. Each model uses its lowest sourced current TTFT report; total response time is excluded. Batch and Flex tiers are excluded. Provider, configuration, prompt and reporting methods can differ, so these are reported observations rather than controlled head-to-head tests. 65 models have no qualifying sourced latency report. Defaults include this model and the nine closest reported values, or the ten leading models if this model has no report. The scale stays fixed across selected pages.

Latency sources for selected models
ModelLatencyProvider / configurationMeasurementSource
DeepSeek V4.1 Flash 10170.182 sBaseten (FAST)DeepSeek V4.1 Flash 1017 (max) (FAST)longmedianArtificial Analysis: DeepSeek V4.1 Flash 1017 (max) (FAST); host Baseten (FAST); standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
DeepSeek V4.1 Flash0.311 sTogether AIDeepSeek V4.1 Flash (max)longmedianArtificial Analysis: DeepSeek V4.1 Flash (max); host Together AI; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
MiniMax M3.1 Flash0.584 sTogether AIMiniMax-M3.1-FlashlongmedianArtificial Analysis: MiniMax-M3.1-Flash; host Together AI; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
GLM-5.30.597 sTogether AIGLM-5.3 (max)longmedianArtificial Analysis: GLM-5.3 (max); host Together AI; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
MiniMax M30.699 sMiniMaxMiniMax-M3source aggregatemedianExplicit first-party AA measurement; reasoning configuration retained. Cross-provider medians are excluded. Retrieval time is not measurement time.SourceChecked 2026-11-02
DeepSeek V4 Pro 08130.832 sDigitalOceanDeepSeek V4 Pro 0813 (max)longmedianArtificial Analysis: DeepSeek V4 Pro 0813 (max); host DigitalOcean; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
Kimi K30.87 sDatabricksKimi K3 (max)longmedianArtificial Analysis: Kimi K3 (max); host Databricks; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
Claude Opus 4.61.35 sAmazonClaude Opus 4.6 (non-reasoning, high)longmedianArtificial Analysis: Claude Opus 4.6 (non-reasoning, high); host Amazon; standard uncached input/output pricing. TTFT is the first streamed token, which may be reasoning. Retrieval time is not measurement time; region/concurrency/quantization not specified in this record.SourceChecked 2026-11-02
GLM-5.3-Flash1.546 sZ.aiGLM-5.3-Flashsource aggregatemedianExplicit first-party AA measurement; reasoning configuration retained. Cross-provider medians are excluded. Retrieval time is not measurement time.SourceChecked 2026-11-02
GLM-5.21.777 sZ.aiGLM-5.2 (Max)source aggregatemedianExplicit first-party AA measurement; reasoning configuration retained. Cross-provider medians are excluded. Retrieval time is not measurement time.SourceChecked 2026-11-02

Reported benchmarks

All published results in our dataset, with versions, evaluation settings, and sources.

All published benchmark reports for SWE-2 Flash
BenchmarkScoreEvaluation setupSource
DeepSWEv1.1Pass@1 · Higher is better60.1%Cognition launch table. Agent harness, effort and task budget not specified; do not merge with mini-swe-agent results.Cognition ↗ (opens in a new tab)provider reported · 2026-11-04
Terminal-Bench2.1 / Cognition SWE-2 Flash launchTask success · Higher is better89.2%Cognition launch table. Harness, effort and task budget not specified; keep separate from Thinking Machines internal harness.Cognition ↗ (opens in a new tab)provider reported · 2026-11-04
Terminal-Bench4.0Task success · Higher is better20%Cognition launch table. Harness, effort and task budget not specified; not the mini-swe-agent track.Cognition ↗ (opens in a new tab)provider reported · 2026-11-04