lapa-v0.1.2-instruct: benchmark results

Ukrainian-focused instruct model from the Lapa LLM university team, built on Gemma 3 12B with a re-tokenized, more efficient Ukrainian vocabulary. Provider: Lapa. Released 2025-10-18. Access: Open.

Aggregate Rating 1532 ± 27, rank #672 of 1656 rated models, from 184 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Ukrainian LLM - Flores CS UK25.02Score (%)100
Ukrainian LLM - Global MMLU Full UK Management78.64Score (%)100
Ukrainian LLM - Long Flores CS UK25.98Score (%)100
Ukrainian LLM - WMT EN UK32.98Score (%)100
EuroEval Ukrainian NLU - Cross Domain UK Reviews65.1Matthews correlation coefficient (%)99.5
EuroEval Croatian NLU - MMS HR47.84Matthews correlation coefficient (%)98.6
EuroEval Slovak NLU - CSFD Sentiment SK64.49Matthews correlation coefficient (%)97.6
EuroEval Czech NLU - CSFD Sentiment66.23Matthews correlation coefficient (%)96.5
Ukrainian LLM - Flores EN UK33.37Score (%)92.3
Ukrainian LLM - Long Flores EN UK32.5Score (%)92.3
EuroEval Serbian NLU - MMS SR50.24Matthews correlation coefficient (%)92.1
Ukrainian LLM - Global MMLU Full UK Formal Logic55.56Score (%)91.7

Interactive version: theaggregate.ai/model?slug=lapa-v0-1-2-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.