gemma3:12B-it-q4_K_M: benchmark results
Provider: Other.
Aggregate Rating 1589 ± 34, rank #1132 of 10916 rated models, from 79 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval French NLU - Allocine | 96.93 | Matthews correlation coefficient (%) | 98.3 |
| EuroEval Norwegian NLU - Norec | 61.91 | Matthews correlation coefficient (%) | 94.5 |
| EuroEval Dutch NLU - CoNLL NL | 71.34 | Micro F1 excluding MISC (%) | 90 |
| EuroEval Icelandic NLU | 50.03 | NLU Average Score (%) | 88.9 |
| EuroEval French NLU - Eltec | 69.52 | Micro F1 excluding MISC (%) | 87.7 |
| EuroEval Danish NLU - Angry Tweets | 56.18 | Matthews correlation coefficient (%) | 86.1 |
| EuroEval Italian NLU - SQuAD IT | 72.6 | Character F1 (%) | 85.9 |
| EuroEval Norwegian | 59.84 | Average Score (%) | 85.2 |
| EuroEval Icelandic NLU - Hotter and Colder Sentiment | 51.58 | Matthews correlation coefficient (%) | 84.7 |
| EuroEval Faroese NLU - FoQA | 73.96 | Character F1 (%) | 84.6 |
| EuroEval Icelandic NLU - ScaLA IS | 30.84 | Matthews correlation coefficient (%) | 84.6 |
| EuroEval Icelandic NLU - MIM-GOLD NER | 67.16 | Micro F1 excluding MISC (%) | 84.4 |
Interactive version: theaggregate.ai/model?slug=gemma3-12b-it-q4-k-m · How It Works · Data refreshed daily, snapshot 2026-11-08.