Gemma 2 2B (IT) — benchmark results

Instruction-tuned Gemma 2 2B checkpoint. Provider: Google. Released 2024-06-27. Access: Open.

Unified ELO 1356 ± 8, rank #1392 of 1776 rated models, from 365 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SeaEval - Dialogue - SAMSum (Zero-Shot)31.12Average ROUGE (0-100)100
SeaEval - Dialogue - DialogSum (Zero-Shot)25.97Average ROUGE (0-100)95.7
LA Leaderboard - AQuAS68.53Accuracy (%)83.8
Open Korean LLM Leaderboard443.88Average Score (%)81.8
EuroEval English NLU - SST-567.9Sentiment classification Score (%)79.2
LA Leaderboard - EusExams Basque35.76Accuracy (%)78.7
Open Japanese LLM - Wiki NER SET F19.73Score (%)76.1
OpenEval - BBQ80.38Exact Match (%)75.9
EuroEval Icelandic NLU - NQII51.87Reading comprehension Score (%)75.2
EuroEval German NLU - Germanquad56.63Reading comprehension Score (%)72.8
Open LLM Leaderboard - IFEval56.68Score68.5
Open CoT - LogiQA5.27CoT Gain (%)65.6

Interactive version: theaggregate.ai/model?slug=gemma-2-2b-it · How the rankings work · Data refreshed daily, snapshot 2026-07-22.