comma-v0.1-2t: benchmark results
Provider: Common Pile. Released 2025-06-05. Access: Open.
Aggregate Rating 1309 ± 33, rank #8568 of 10916 rated models, from 104 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval English NLU - SQuAD | 90.35 | Character F1 (%) | 98.8 |
| EuroEval French NLU - FQuAD | 70.27 | Character F1 (%) | 77.5 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 72.93 | Character F1 (%) | 73.7 |
| EuroEval German NLU - Germanquad | 52.95 | Character F1 (%) | 55.5 |
| EuroEval Spanish NLU - MLQA ES | 60.12 | Character F1 (%) | 52.6 |
| EuroEval Italian NLU - SQuAD IT | 62.91 | Character F1 (%) | 43.6 |
| EuroEval Spanish NLU - ScaLA ES | 6.46 | Matthews correlation coefficient (%) | 42.1 |
| EuroEval Faroese NLU - FoQA | 37.52 | Character F1 (%) | 41.1 |
| EuroEval English NLU | 59.17 | NLU Average Score (%) | 40.9 |
| EuroEval Faroese NLU - FONE | 55.54 | Micro F1 excluding MISC (%) | 39.2 |
| EuroEval Dutch NLU - SQuAD NL | 66.29 | Character F1 (%) | 38.9 |
| EuroEval Spanish NLU | 37.8 | NLU Average Score (%) | 38.8 |
Interactive version: theaggregate.ai/model?slug=comma-v0-1-2t · How It Works · Data refreshed daily, snapshot 2026-11-08.