Gemini 1.5 Pro (002): benchmark results
Gemini 1.5 Pro 002 stable API snapshot. Provider: Google. Released 2024-09-24. Access: API.
Aggregate Rating 1631 ± 7, rank #349 of 1656 rated models, from 1714 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| CapArena-Auto | 56.2 | CapArena-Auto Score (avg) | 100 |
| CapArena-Auto vs CogVLM-19B | 61 | CapArena-Auto Score (vs CogVLM-19B) | 100 |
| CapArena-Auto vs GPT-4o | 29 | CapArena-Auto Score (vs GPT-4o) | 100 |
| CapArena-Auto vs MiniCPM-8B | 78.5 | CapArena-Auto Score (vs MiniCPM-8B) | 100 |
| HELM Audio - Multilingual Librispeech | 5.39 | WER | 100 |
| HELM Finance - FinQA | 58.7 | Program Accuracy | 100 |
| HELM Lite - MATH Level 1 | 91.99 | Equivalent (CoT) (%) | 100 |
| HELM Lite - MATH Level 1 - Number Theory | 100 | Equivalent (CoT) (%) | 100 |
| HELM MMLU - College Chemistry | 67 | EM | 100 |
| HELM MMLU - College Mathematics | 80 | EM | 100 |
| HELM MMLU - College Physics | 86.27 | EM | 100 |
| HELM MMLU - High School Biology | 95.81 | EM | 100 |
Interactive version: theaggregate.ai/model?slug=gemini-1-5-pro-002 · How It Works · Data refreshed daily, snapshot 2026-10-20.