Gemini 1.5 Flash (Sep '24) — benchmark results
Provider: Google. Released 2024-09-24. Access: API.
Unified ELO 1491 ± 32, rank #878 of 1841 rated models, from 8 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA MATH-500 | 82.73 | Accuracy (%) | 50 |
| Epoch AI - Scicode | 26.74 | Score | 32 |
| AA MMLU-Pro | 67.99 | Accuracy (%) | 31.4 |
| AA LiveCodeBench | 27.3 | Pass@1 (%) | 29.5 |
| Artificial Analysis Intelligence Index | 7.96 | Intelligence Index | 24.6 |
| AA GPQA Diamond | 46.26 | Accuracy (%) | 22.3 |
| AA MMMU-Pro | 48.38 | Accuracy (%) | 15.9 |
| AA Humanity's Last Exam | 3.46 | Accuracy (%) | 3.8 |
Interactive version: theaggregate.ai/model?slug=gemini-1-5-flash-sep-24 · How It Works · Data refreshed daily, snapshot 2026-07-25.