MamayLM-Gemma-3-12B-IT-v1.0 — benchmark results
INSAIT's Ukrainian-focused fine-tune of Gemma 3 12B, leading Ukrainian benchmarks while retaining English skill (2025). Provider: Other. Released 2025-05-01. Access: Open.
Unified ELO 1572 ± 20, rank #557 of 1776 rated models, from 184 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Ukrainian LLM - Global MMLU Full UK Human Sexuality | 80.92 | Score (%) | 100 |
| Ukrainian LLM - Global MMLU Full UK Virology | 56.63 | Score (%) | 100 |
| EuroEval Ukrainian NLU - Cross Domain UK Reviews | 64.08 | Sentiment classification Score (%) | 98 |
| EuroEval Croatian NLU - MMS HR | 47.14 | Sentiment classification Score (%) | 97.6 |
| EuroEval Serbian NLU - MMS SR | 51.48 | Sentiment classification Score (%) | 97.5 |
| EuroEval Slovak NLU - CSFD Sentiment SK | 62.23 | Sentiment classification Score (%) | 94.6 |
| EuroEval Ukrainian NLU - ScaLA UK | 42.16 | Linguistic acceptability Score (%) | 92.5 |
| Ukrainian LLM - Global MMLU Full UK Abstract Algebra | 41 | Score (%) | 92.3 |
| Ukrainian LLM - Global MMLU Full UK High School US History | 86.27 | Score (%) | 92.3 |
| Ukrainian LLM - Global MMLU Full UK Marketing | 87.61 | Score (%) | 92.3 |
| Ukrainian LLM - Global MMLU Full UK Medical Genetics | 83 | Score (%) | 92.3 |
| EuroEval Czech NLU - CSFD Sentiment | 62.56 | Sentiment classification Score (%) | 91.7 |
Interactive version: theaggregate.ai/model?slug=mamaylm-gemma-3-12b-it-v1-0 · How the rankings work · Data refreshed daily, snapshot 2026-07-22.