AA-Briefcase
1.1 / combined Elo ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
Compare models
Find the right model, side by side.
Updated: Data as of:
First model
Second model
Model specifications
| Specifications |  Gemini 3.8 FlashGoogle |  GPT-6 AstraOpenAI |
|---|---|---|
| Provider | ||
| Context sizetokens | 1,000,000 | 1,000,000 |
| Cutoff date | Not reported | 2026-04-30 |
| Input costUSD / 1M tokens | $0.75 | $10.00 |
| Output costUSD / 1M tokens | $3.75 | $50.00 |
| Max outputtokens | 65,536 | 128,000 |
| LatencyTTFT · seconds | 27.1 | 365.127 |
| Speedtokens / sec | 136.644 | 70.564 |
Benchmark performance
18 shared benchmark comparisons. Versions and setups matched.
Gemini 3.8 FlashGPT-6 Astra
AutomationBench
1.0.6 / Zapier held-out private set ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
AutomationBench-AA
1.0.6 / AA private 657 ↗Tools enabled- Gemini 3.8 Flash:
- GPT-6 Astra:
- Gemini 3.8 Flash:
- GPT-6 Astra:
DeepSWE
v1.1 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
- Gemini 3.8 Flash:
- GPT-6 Astra:
GDPval-AA
2.1 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
GPQA Diamond
Diamond / Independent evaluation ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
HLE-Diamond
1,000 questions / no tools ↗No tools- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Agentic
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Browser Use
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Coding
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Data Analysis
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Design
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Reasoning
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
LiveBench: Research
2.0 / 2026-10-25 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
Terminal-Bench
4.0 / mini-swe-agent ↗mini-swe-agent- Gemini 3.8 Flash:
- GPT-6 Astra:
Terminal-Bench
4.0 ↗- Gemini 3.8 Flash:
- GPT-6 Astra:
