Gemma 4 12B: benchmark results
Google DeepMind's Gemma 4 12B, an encoder-free multimodal model handling text, image and audio input, with a 256K context window and support for 140+ languages. Provider: Google. Released 2026-06-03. Access: Open.
Aggregate Rating 1565 ± 17, rank #557 of 1635 rated models, from 102 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA IFBench | 73.54 | Accuracy (%) | 91.3 |
| AI for Education Pedagogy - Technology | 85.85 | Accuracy (%) | 88.5 |
| SEA-HELM | 69.31 | Mean Score (%) | 82.5 |
| LLM Stats (MathVision) | 79.7 | Score (%) | 69 |
| AA Omniscience - Software Engineering (SWE) - HTML | 34.69 | Accuracy (%) | 67.7 |
| AA Humanity's Last Exam | 15.66 | Accuracy (%) | 61.6 |
| IHBench - Recovery Quality - Filler | 25 | Recovery pass rate (%; 60 backchannel fillers, where the tur | 61.5 |
| ECGQuest | 62.9 | Accuracy (%; 1,050 held-out true/false questions on ECG know | 61.4 |
| IHBench - Task Fulfillment | 51.1 | Win rate against GPT-4o Audio (%; share of 428 interruption | 60 |
| AA-Omniscience Hallucination Rate | 73.41 | Hallucination Rate (%) | 59.2 |
| AA Omniscience - Software Engineering (SWE) - Rust | 50 | Accuracy (%) | 59 |
| AI for Education SEND | 77.06 | Accuracy (%) | 58.4 |
Interactive version: theaggregate.ai/model?slug=gemma-4-12b · How It Works · Data refreshed daily, snapshot 2026-10-15.