DeepSeekCoder
Explore DeepSeekCoder’s published benchmark results and provider offerings below. More comparable task results are needed to describe its strongest areas.
Updated: Data as of:
Strongest results
More comparable benchmark results are needed.
Model details
| Model | DeepSeekCoder |
|---|---|
| Agent Index v1.2 | Insufficient coverage (0/7) · Preview |
| Creator | DeepSeek (opens in a new tab) |
| Availability | Open source / open weights |
| Context size | Not reported |
| Max output | Not reported |
| Knowledge cutoff | Not reported |
| License | Not reported |
Pricing and performance
Per provider and reported configuration. Prices are USD per 1M tokens.
No provider pricing or performance reports have been added for this model yet.
Reported benchmarks
All published results in our dataset, with versions, evaluation settings, and sources.
| Benchmark | Score | Evaluation setup | Source |
|---|---|---|---|
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 0.7% | agent: PlanExec · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: DeepSeekCoder · split: Test-Challenge · test challenge sgc: 0 · test normal sgc: 0 · test normal tgc: 1.8 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 2.9% | agent: ReAct · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: DeepSeekCoder · split: Test-Challenge · test challenge sgc: 0.7 · test normal sgc: 1.8 · test normal tgc: 7.1 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |
| AppWorldTest-ChallengeTask Goal Completion · Higher is better | 5.8% | agent: FullCodeRefl · metric: TGC · selection: All 23 leaderboard submissions; latest report date and best score at that date shown per model. Normal-split and SGC values retained in the source data/settings, not mixed into the ranking. · source model label: DeepSeekCoder · split: Test-Challenge · test challenge sgc: 2.9 · test normal sgc: 8.9 · test normal tgc: 13.1 | AppWorld research team ↗ (opens in a new tab)benchmark publisher · 2024-07-26 |