New: Agent Index for knowledge work is live.Explore the index ↗

Explore LLaMA3-70B’s published benchmark results and provider offerings below. More comparable task results are needed to describe its strongest areas.

Updated: Data as of:

Strongest results

More comparable benchmark results are needed.

Model details

Open source / open weights1 benchmarks
Specifications for LLaMA3-70B
ModelLLaMA3-70B
Agent Index v1.2Insufficient coverage (0/7) · Preview
CreatorMeta (opens in a new tab)
AvailabilityOpen source / open weights
Context sizeNot reported
Max outputNot reported
Knowledge cutoffNot reported
LicenseNot reported

Pricing and performance

Per provider and reported configuration. Prices are USD per 1M tokens.

No provider pricing or performance reports have been added for this model yet.

Reported benchmarks

All published results in our dataset, with versions, evaluation settings, and sources.

All published benchmark reports for LLaMA3-70B
BenchmarkScoreEvaluation setupSource
AppWorldTest-ChallengeTask Goal Completion · Higher is better3.4%agent: ReAct · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: LLaMA3-70B · split: Test-Challenge · test challenge sgc: 0 · test normal sgc: 8.9 · test normal tgc: 20.8AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26
AppWorldTest-ChallengeTask Goal Completion · Higher is better2.4%agent: PlanExec · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: LLaMA3-70B · split: Test-Challenge · test challenge sgc: 0.7 · test normal sgc: 1.8 · test normal tgc: 8.9AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26
AppWorldTest-ChallengeTask Goal Completion · Higher is better7%agent: FullCodeRefl · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: LLaMA3-70B · split: Test-Challenge · test challenge sgc: 4.3 · test normal sgc: 17.9 · test normal tgc: 24.4AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26