Reasoning
198-question Diamond subset; independent AA evaluation
- 01
- 02
- 03
- 03
- 03
- 23
Across the task benchmarks we track, GLM-5.2’s strongest relative results are in terminal use, knowledge work, and work automations. On Terminal-Bench 2.1, it scores 77.9%, ranking #5 among 13 models with reported results in our dataset.
| Benchmark | Measures | Score |
|---|---|---|
| Humanity's Last Exam ↗Stable HLE — text-only subset | Expert reasoning | 41.15%#29 of 68 |
| AA-Briefcase ↗1.1 / combined Elo | Business deliverables | 1,227.23 Elo#34 of 57 |
| GDPval-AA ↗2.1 | Knowledge work | 1,381.49 Elo#25 of 38 |
| IFBench ↗58 constraint types | Precise instruction following | 73.33%#12 of 17 |
| Model | GLM-5.2 |
|---|---|
| Agent Index v1.2 | Insufficient coverage (3/7) · Preview |
| Creator | Z.ai (opens in a new tab) |
| Availability | Open source / open weights |
| Context size | 1,000,000 tokens (opens in a new tab) |
| Max output | Not reported |
| Knowledge cutoff | Not reported |
| License | MIT · Model weights ↗ (opens in a new tab) |
Per provider and reported configuration. Prices are USD per 1M tokens.
| Provider / configuration | Contexttokens | InputUSD / 1M tokens | OutputUSD / 1M tokens | LatencyTTFT · seconds | Speedtokens / sec |
|---|---|---|---|---|---|
| GLM-5.2 (Max) | 1,000,000 | $1.40 (opens in a new tab) | $4.40 (opens in a new tab) | 1.777 (opens in a new tab) | 94.073 (opens in a new tab) |
GLM-5.2 in color, alongside leading models. Latest stored reports, best effort per report date.
198-question Diamond subset; independent AA evaluation
89 tasks; Terminus 2; e2b; three repeats
Private 657 tasks; 50 turns; objective completion
220 tasks; Stirrup agent; pairwise Elo
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AA-Briefcase1.1 / combined EloCombined Elo · Higher is better | 1,227.23 Elo | selection: best reported configuration per release · GLM-5.2 (Max) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| AutomationBench-AA1.0.6 / AA private 657Objectives completed without guardrail violations · Higher is better | 28.399% | GLM-5.2 (Max); Private 657 tasks; 50 turns; objective completion | Artificial Analysis (opens in a new tab)independent |
| GDP.pdf100 tasks / All-pass / five attemptsAccuracy · Higher is better | 10.4% | selection: best reported configuration per release · GLM-5.2 (Max) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,381.49 Elo | GLM-5.2 (Max); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GDPval-AA2.1Elo · Higher is better | 1,251.81 Elo | GLM-5.2 (Non-reasoning); 220 tasks; Stirrup agent; pairwise Elo | Artificial Analysis (opens in a new tab)independent |
| GPQADiamond / Artificial AnalysisAccuracy · Higher is better | 89.495% | GLM-5.2 (Max); 198-question Diamond subset; independent AA evaluation | Artificial Analysis (opens in a new tab)independent |
| GPQADiamond / Artificial AnalysisAccuracy · Higher is better | 68.586% | GLM-5.2 (Non-reasoning); 198-question Diamond subset; independent AA evaluation | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 54.7% | Text-only per model-card footnote; 163840 generation; 300K context; no context management; GPT-5.5 medium judge · Tools enabled | Z.ai ↗ (opens in a new tab)provider reported |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 41.149% | GLM-5.2 (Max); original HLE text-only 2,158 questions; no tools; not HLE Diamond · No tools | Artificial Analysis (opens in a new tab)independent |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 9.778% | GLM-5.2 (Non-reasoning); original HLE text-only 2,158 questions; no tools; not HLE Diamond · No tools | Artificial Analysis (opens in a new tab)independent |
| IFBench58 constraint typesAccuracy · Higher is better | 73.333% | selection: best reported configuration per release · GLM-5.2 (Max) · tools: benchmark-defined | Artificial Analysis (opens in a new tab)independent |
| Terminal-Bench2.1 / Artificial AnalysisPass@1 · Higher is better | 77.903% | GLM-5.2 (Max); 89 tasks; Terminus 2; e2b; three repeats | Artificial Analysis (opens in a new tab)independent |
| Terminal-Bench2.1 / Artificial AnalysisPass@1 · Higher is better | 51.685% | GLM-5.2 (Non-reasoning); 89 tasks; Terminus 2; e2b; three repeats | Artificial Analysis (opens in a new tab)independent |
| Terminal-Bench2.1 / published open-model reportsTask success · Higher is better | 81% | harness comparison: provider-reported; settings differ across models · Terminus 2; JSON parser; 4h; 500 episodes; 256K context | Z.ai ↗ (opens in a new tab)provider reported |
| Terminal-Bench4.0 / mini-swe-agentTask success · Higher is better | 1.01% | harness: mini-swe-agent · repeats: 3 · selection: best reported configuration per release · GLM-5.2 (Max) | Artificial Analysis (opens in a new tab)independent |