ruT5-base: benchmark results
Provider: Other.
Unified ELO 1158 ± 39, rank #1490 of 1537 rated models, from 31 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MERA Original Paper - ruOpenBookQA | 26.5 | Accuracy (%; 5-shot, log-likelihood) | 63.9 |
| MERA Original Paper - MathLogicQA | 25.9 | Accuracy (%; 5-shot, log-likelihood) | 55.6 |
| MERA Original Paper - SimpleAr | 0 | Exact Match (%; 5-shot, greedy generation) | 22.2 |
| MERA Original Paper - ruWorldTree | 23.4 | Accuracy (%; 5-shot, log-likelihood) | 22.2 |
| MERA Original Paper | 19.3 | Total Score (%; mean of 17 problem-solving and exam tasks, M | 19.4 |
| MERA Original Paper - ruModAr | 0 | Exact Match (%; greedy generation) | 19.4 |
| MERA Original Paper - ruMultiAr | 0 | Exact Match (%; 5-shot, greedy generation) | 19.4 |
| MERA - LCS | 8.8 | Accuracy (%) | 18.2 |
| MERA Original Paper - ruMMLU | 23.7 | Accuracy (%; 5-shot, log-likelihood) | 16.7 |
| MERA - ruHHH | 49.44 | Accuracy (%) | 13.7 |
| MERA - RWSD | 47.31 | Accuracy (%) | 13.2 |
| MERA - RCB | 36.99 | Accuracy (%) | 10.8 |
Interactive version: theaggregate.ai/model?slug=rut5-base · How It Works · Data refreshed daily, snapshot 2026-09-25.