GaMS3-12B-Instruct: benchmark results
University of Ljubljana's GaMS3-12B-Instruct, a Gemma 3 12B model continually pretrained on Slovene, English and some Croatian, Serbian and Bosnian text, then instruction-tuned on Slovene and English data. Provider: University of Ljubljana. Released 2025-12-04. Access: Open.
Aggregate Rating 1522 ± 20, rank #706 of 1635 rated models, from 59 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Belebele European - Hungarian | 88 | Accuracy (%, 0-shot) | 100 |
| INCLUDE-base-44 European Languages | 65.79 | Average Accuracy (%) | 100 |
| Belebele European - Albanian | 86.22 | Accuracy (%, 0-shot) | 96.4 |
| Belebele European - Estonian | 84.33 | Accuracy (%, 0-shot) | 96.4 |
| Belebele European - Icelandic | 82.56 | Accuracy (%, 0-shot) | 96.4 |
| Belebele European - Slovenian | 86.78 | Accuracy (%, 0-shot) | 92.9 |
| Belebele European - Greek | 87.33 | Accuracy (%, 0-shot) | 89.3 |
| Belebele European - Serbian | 86.44 | Accuracy (%, 0-shot) | 89.3 |
| Belebele European - Danish | 88.33 | Accuracy (%, 0-shot) | 85.7 |
| Belebele European - Latvian | 86 | Accuracy (%, 0-shot) | 85.7 |
| Belebele European - Lithuanian | 83.33 | Accuracy (%, 0-shot) | 85.7 |
| Belebele European - Turkish | 83.67 | Accuracy (%, 0-shot) | 85.7 |
Interactive version: theaggregate.ai/model?slug=gams3-12b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-05.