Gemini 1.5 Pro (002) — benchmark results

Gemini 1.5 Pro 002 stable API snapshot. Provider: Google. Released 2024-09-24. Access: API.

Unified ELO 1628 ± 6, rank #417 of 1776 rated models, from 949 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
BRIDGE Medical Leaderboard - Few-Shot55.51Average Performance (%)100
CapArena-Auto56.2CapArena-Auto Score (avg)100
CapArena-Auto vs CogVLM-19B61CapArena-Auto Score (vs CogVLM-19B)100
CapArena-Auto vs GPT-4o29CapArena-Auto Score (vs GPT-4o)100
CapArena-Auto vs MiniCPM-8B78.5CapArena-Auto Score (vs MiniCPM-8B)100
HELM Finance - FinQA58.7Program Accuracy100
MEGA-Bench Task - Actor Recognition In Movie100Task Score (%)100
MEGA-Bench Task - Autorater Mask85.7Task Score (%)100
MEGA-Bench Task - Constrained Generation Contain Position Length93.3Task Score (%)100
MEGA-Bench Task - Constrained Generation Multi Contain Repeat6.7Task Score (%)100
MEGA-Bench Task - Counting Multi Image71.4Task Score (%)100
MEGA-Bench Task - FigureQA71.4Task Score (%)100

Interactive version: theaggregate.ai/model?slug=gemini-1-5-pro-002 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.