Tiny Aya Earth: benchmark results
Provider: Cohere. Access: Open.
Aggregate Rating 1418 ± 41, rank #5332 of 10489 rated models, from 18 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| AfriScience-MT (10-Shot) | 55.3 | SSA-COMET (0-100; sentence-level, mean over the 12 English<- | 50 |
| AfriScience-MT - Document Level (Zero-Shot) | 38.8 | SSA-COMET (0-100; whole-summary translation, mean over the 1 | 50 |
| AfriScience-MT (Zero-Shot) - English to Luganda | 37.9 | SSA-COMET (0-100; sentence-level eng->lug on the test split; | 42.9 |
| AfriScience-MT (Zero-Shot) - Yoruba to English | 41.8 | SSA-COMET (0-100; sentence-level yor->eng on the test split; | 42.9 |
| AfriScience-MT - Document Level (1-Shot) | 36.5 | SSA-COMET (0-100; whole-summary translation, mean over the 1 | 40 |
| AfriScience-MT (Zero-Shot) - English to Yoruba | 37.9 | SSA-COMET (0-100; sentence-level eng->yor on the test split; | 39.3 |
| AfriScience-MT (Zero-Shot) - English to Northern Sotho | 36.6 | SSA-COMET (0-100; sentence-level eng->nso on the test split; | 35.7 |
| AfriScience-MT (Zero-Shot) - English to isiZulu | 33.3 | SSA-COMET (0-100; sentence-level eng->zul on the test split; | 28.6 |
| AfriScience-MT (Zero-Shot) - Luganda to English | 41 | SSA-COMET (0-100; sentence-level lug->eng on the test split; | 28.6 |
| AfriScience-MT (Zero-Shot) | 36.4 | SSA-COMET (0-100; sentence-level, mean over the 12 English<- | 25 |
| AfriScience-MT (Zero-Shot) - English to Amharic | 27.1 | SSA-COMET (0-100; sentence-level eng->amh on the test split; | 21.4 |
| AfriScience-MT (Zero-Shot) - isiZulu to English | 38.6 | SSA-COMET (0-100; sentence-level zul->eng on the test split; | 21.4 |
Interactive version: theaggregate.ai/model?slug=tiny-aya-earth · How It Works · Data refreshed daily, snapshot 2026-11-20.