GPT-4 Turbo
Explore GPT-4 Turbo’s published benchmark results and provider offerings below. More comparable task results are needed to describe its strongest areas.
Updated: Data as of:
Strongest results
| Benchmark | Measures | Score |
|---|---|---|
| Humanity's Last Exam ↗Stable HLE — text-only subset | Expert reasoning | 3.1%#68 of 68 |
Model details
| Model | GPT-4 Turbo |
|---|---|
| Agent Index v1.2 | Insufficient coverage (0/7) · Preview |
| Creator | OpenAI (opens in a new tab) |
| Availability | Proprietary |
| Context size | Not reported |
| Max output | Not reported |
| Knowledge cutoff | Not reported |
| License | Not reported |
Pricing and performance
Per provider and reported configuration. Prices are USD per 1M tokens.
No provider pricing or performance reports have been added for this model yet.
Reported benchmarks
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 11% | agent: PlanExec · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: GPT-4 Turbo · split: Test-Challenge · test challenge sgc: 3.6 · test normal sgc: 16.1 · test normal tgc: 32.7 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 17.5% | agent: ReAct · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: GPT-4 Turbo · split: Test-Challenge · test challenge sgc: 5.8 · test normal sgc: 12.5 · test normal tgc: 26.8 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 12.5% | agent: FullCodeRefl · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: GPT-4 Turbo · split: Test-Challenge · test challenge sgc: 7.2 · test normal sgc: 19.6 · test normal tgc: 25.6 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 14.6% | agent: IPFunCall · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: GPT-4 Turbo · split: Test-Challenge · test challenge sgc: 9.3 · test normal sgc: 21.4 · test normal tgc: 30.4 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |
| Humanity's Last ExamStable HLE — text-only subsetAccuracy · Higher is better | 3.1% | question count: 2158 · reported precision decimals: 1 · GPT-4 Turbo; original HLE; 2,158 text-only questions; no tools; pass@1; chart labels rounded to one decimal. · source model href: /models/gpt-4-turbo · subset: text · No tools | Artificial Analysis (opens in a new tab)independent |