gemma3:12B-it-fp16: benchmark results

Provider: Other.

Aggregate Rating 1594 ± 35, rank #1067 of 10916 rated models, from 79 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval French NLU - Allocine96.76Matthews correlation coefficient (%)97.3
EuroEval Norwegian NLU - Norec62.27Matthews correlation coefficient (%)95.1
EuroEval French NLU - Eltec72.66Micro F1 excluding MISC (%)94.7
EuroEval Faroese NLU - FoQA75.27Character F1 (%)89.3
EuroEval Icelandic NLU50.01NLU Average Score (%)88.6
EuroEval Dutch NLU - CoNLL NL70.37Micro F1 excluding MISC (%)88.5
EuroEval Italian NLU - SQuAD IT73.11Character F1 (%)88.5
EuroEval Norwegian61.34Average Score (%)87.5
EuroEval Icelandic NLU - ScaLA IS32.22Matthews correlation coefficient (%)85.4
EuroEval Norwegian Knowledge43.85Knowledge Average Score (%)84.1
EuroEval Icelandic NLU - Hotter and Colder Sentiment50.56Matthews correlation coefficient (%)82.9
EuroEval French NLU67.76NLU Average Score (%)82.6

Interactive version: theaggregate.ai/model?slug=gemma3-12b-it-fp16 · How It Works · Data refreshed daily, snapshot 2026-11-08.