Gemini 1.5 Flash (Sep '24): benchmark results
Provider: Google. Released 2024-09-24. Access: API.
Aggregate Rating 1511 ± 41, rank #2179 of 10916 rated models, from 5 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA MMLU-Pro | 67.99 | Accuracy (%) | 31.6 |
| AA LiveCodeBench | 27.3 | Pass@1 (%) | 29.5 |
| AA GPQA Diamond | 46.26 | Accuracy (%) | 20.4 |
| AA MMMU-Pro | 48.38 | Accuracy (%) | 12.3 |
| AA Humanity's Last Exam | 3.17 | Accuracy (%) | 2.8 |
Interactive version: theaggregate.ai/model?slug=gemini-1-5-flash-sep-24 · How It Works · Data refreshed daily, snapshot 2026-11-08.