Gemma 4 12B (Non-reasoning): benchmark results
Provider: Google. Released 2026-06-03. Access: Open.
Aggregate Rating 1458 ± 17, rank #1260 of 2201 rated models, from 51 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AA-Omniscience Hallucination Rate | 73.41 | Hallucination Rate (%) | 57.2 |
| IHBench - Task Fulfillment | 50.5 | Win rate against GPT-4o Audio (%; share of 428 interruption | 56 |
| AA Omniscience - Software Engineering (SWE) - HTML | 30 | Accuracy (%) | 51.7 |
| AA IFBench | 45.17 | Accuracy (%) | 51.6 |
| AA Omniscience - Software Engineering (SWE) - Swift | 32 | Accuracy (%) | 51.2 |
| AMIGO (Threshold 0.3) | 4.9 | Verified Correct accuracy in percent on AMIGO's dress galler | 50 |
| MSI-Bench - English | 22.6 | All-pass rate (%; all 576 English test cases over six multi- | 50 |
| MSI-Bench - English Speaker Authority | 42.7 | All-pass rate (%; the 96 speaker-authority cases, where an u | 50 |
| MSI-Bench - Mandarin Selective Disclosure | 27.1 | All-pass rate (%; the 96 selective-disclosure cases, where e | 50 |
| IHBench - Recovery Quality - Filler | 22 | Recovery pass rate (%; 60 backchannel fillers, where the tur | 48.1 |
| AA Terminal-Bench Hard | 11.36 | Accuracy (%) | 46.8 |
| AA Omniscience - Software Engineering (SWE) - Dart | 16 | Accuracy (%) | 43.7 |
Interactive version: theaggregate.ai/model?slug=gemma-4-12b-non-reasoning · How It Works · Data refreshed daily, snapshot 2026-11-12.