Gemini 1.5 Pro (0514): benchmark results
May 2024 Gemini 1.5 Pro API snapshot, tracked when sources report the dated model. Provider: Google. Released 2024-05-14. Access: API.
Aggregate Rating 1579 ± 27, rank #512 of 1656 rated models, from 20 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| BenchBench | 82.95 | Aggregate Score (%) | 87.5 |
| RewardBench Chat Hard | 80.59 | Accuracy (%) | 81.8 |
| RewardBench | 88.2 | Score (%) | 77.8 |
| RewardBench Reasoning | 91.99 | Accuracy (%) | 77.5 |
| RewardBench Safety | 87.91 | Accuracy (%) | 74.4 |
| BigCodeBench | 43.8 | Pass@1 (%) | 72 |
| SEAL - Spanish | 1069 | Score | 61.9 |
| SEAL - Coding | 994 | Score | 40.7 |
| SEAL - Math | 92.28 | Score | 40 |
| RewardBench Chat | 92.32 | Accuracy (%) | 38.6 |
| Epoch AI - ECI | 126.92 | ECI Score | 35.6 |
| AA MMLU-Pro | 65.74 | Accuracy (%) | 28.2 |
Interactive version: theaggregate.ai/model?slug=gemini-1-5-pro-0514 · How It Works · Data refreshed daily, snapshot 2026-10-20.