Gemini 1.5 Flash (002): benchmark results
Gemini 1.5 Flash 002 stable API snapshot. Provider: Google. Released 2024-09-24. Access: API.
Aggregate Rating 1560 ± 8, rank #583 of 1656 rated models, from 1612 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| HELM AIR-Bench 2024 - #4.4: Employment | 76.67 | Refusal Rate (%) | 100 |
| HELM Image2Struct - Image2Latex | 70.92 | EMS | 100 |
| HELM Image2Struct - Image2Latex Algorithm | 77.74 | EMS | 100 |
| HELM Image2Struct - Image2Latex Plot | 63.3 | EMS | 100 |
| HELM Lite - MATH Level 1 - Counting and Probability | 97.44 | Equivalent (CoT) (%) | 100 |
| HELM TORR - Numeric Nlg | 19.26 | ROUGE-L | 100 |
| HELM AIR-Bench 2024 - #5.11: Heavy machinery | 60 | Refusal Rate (%) | 99.4 |
| HELM Lite - MATH Level 1 - Geometry | 81.58 | Equivalent (CoT) (%) | 98.9 |
| MEGA-Bench Task - NLVR2 Two Image Compare QA | 85.7 | Task Score (%) | 98.8 |
| MEGA-Bench Task - Video Content Reasoning | 88.9 | Task Score (%) | 98.8 |
| MEGA-Bench Task - Webpage Code Understanding | 88.9 | Task Score (%) | 98.8 |
| HELM Lite - MATH Level 1 - Intermediate Algebra | 84.62 | Equivalent (CoT) (%) | 98.3 |
Interactive version: theaggregate.ai/model?slug=gemini-1-5-flash-002 · How It Works · Data refreshed daily, snapshot 2026-10-20.