Gemma 3 1B: benchmark results
Google's open-weight Gemma 3 1B, the smallest, text-only Gemma 3 tier (March 2025). Provider: Google. Released 2025-03-12. Access: Open.
Aggregate Rating 1261 ± 18, rank #1528 of 1656 rated models, from 140 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Syslog Severity Classification - RAG | 85.28 | Accuracy on 9,355 held-out journalctl logs, exact syslog sev | 75 |
| SSP-Bench - Safety | 93.8 | Safety rate (%; share of the 1,768 generated harmful prompts | 60.9 |
| aiXamine - Over-Refusal | 84.3 | Service score (0-100; normalized pass rate) | 48.8 |
| SSP-Bench - Over-Refusal | 96.3 | Compliance rate (%; share of 684 generated benign boundary q | 47.8 |
| EuroEval Icelandic NLU - ScaLA IS | 2.33 | Matthews correlation coefficient (%) | 46.1 |
| EuroEval Faroese NLU - ScaLA FO | 1.99 | Matthews correlation coefficient (%) | 43.2 |
| EuroEval Danish NLU - Angry Tweets | 40.29 | Matthews correlation coefficient (%) | 39.1 |
| aiXamine - Jailbreak Robustness | 53.5 | Service score (0-100; normalized pass rate) | 39 |
| aiXamine - Safety Alignment | 93.8 | Service score (0-100; normalized pass rate) | 39 |
| Syslog Severity Classification - Few-Shot | 20.25 | Accuracy on 9,355 held-out journalctl logs, exact syslog sev | 37.5 |
| EuroEval Swedish NLU - Swerec | 69.66 | Matthews correlation coefficient (%) | 35.4 |
| EuroEval Norwegian NLU - ScaLA NN | 7.14 | Matthews correlation coefficient (%) | 35.1 |
Interactive version: theaggregate.ai/model?slug=gemma-3-1b · How It Works · Data refreshed daily, snapshot 2026-10-20.