tiny-aya-water: benchmark results
Cohere Labs Tiny Aya Water is the regionally specialized chat release for European and Asia-Pacific languages, derived from Tiny Aya Base. The publisher reports a 3.35B multilingual model with 8K input context. Provider: Cohere. Released 2026-02-17. Access: Open.
Aggregate Rating 1388 ± 23, rank #6599 of 10524 rated models, from 387 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Albanian Summarization - LR SUM SQ | 34.8 | chrF3++ (%) | 98.7 |
| EuroEval Catalan NLU - Guia CAT | 74.43 | Matthews correlation coefficient (%) | 97.2 |
| EuroEval Italian NLU - SQuAD IT | 74.89 | Character F1 (%) | 96 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 76.85 | Character F1 (%) | 91.2 |
| EuroEval Spanish Summarization - Mlsum ES | 29.02 | chrF3++ (%) | 89.8 |
| EuroEval Bulgarian NLU - MultiWikiQA BG | 74.66 | Character F1 (%) | 89.1 |
| EuroEval Bosnian NLU - MMS BS | 49.63 | Matthews correlation coefficient (%) | 88.6 |
| EuroEval Serbian Summarization - LR SUM SR | 30.28 | chrF3++ (%) | 88.4 |
| EuroEval Italian Summarization - Ilpost SUM | 38.32 | chrF3++ (%) | 88 |
| EuroEval Spanish NLU - MLQA ES | 66.63 | Character F1 (%) | 88 |
| EuroEval Slovene NLU - Sentinews | 51.7 | Matthews correlation coefficient (%) | 87.2 |
| EuroEval Dutch NLU - SQuAD NL | 78.13 | Character F1 (%) | 86.4 |
Interactive version: theaggregate.ai/model?slug=tiny-aya-water · How It Works · Data refreshed daily, snapshot 2026-11-22.