Tiny Aya Earth: benchmark results

Provider: Cohere. Access: Open.

Aggregate Rating 1418 ± 41, rank #5332 of 10489 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AfriScience-MT (10-Shot)55.3SSA-COMET (0-100; sentence-level, mean over the 12 English<-50
AfriScience-MT - Document Level (Zero-Shot)38.8SSA-COMET (0-100; whole-summary translation, mean over the 150
AfriScience-MT (Zero-Shot) - English to Luganda37.9SSA-COMET (0-100; sentence-level eng->lug on the test split;42.9
AfriScience-MT (Zero-Shot) - Yoruba to English41.8SSA-COMET (0-100; sentence-level yor->eng on the test split;42.9
AfriScience-MT - Document Level (1-Shot)36.5SSA-COMET (0-100; whole-summary translation, mean over the 140
AfriScience-MT (Zero-Shot) - English to Yoruba37.9SSA-COMET (0-100; sentence-level eng->yor on the test split;39.3
AfriScience-MT (Zero-Shot) - English to Northern Sotho36.6SSA-COMET (0-100; sentence-level eng->nso on the test split;35.7
AfriScience-MT (Zero-Shot) - English to isiZulu33.3SSA-COMET (0-100; sentence-level eng->zul on the test split;28.6
AfriScience-MT (Zero-Shot) - Luganda to English41SSA-COMET (0-100; sentence-level lug->eng on the test split;28.6
AfriScience-MT (Zero-Shot)36.4SSA-COMET (0-100; sentence-level, mean over the 12 English<-25
AfriScience-MT (Zero-Shot) - English to Amharic27.1SSA-COMET (0-100; sentence-level eng->amh on the test split;21.4
AfriScience-MT (Zero-Shot) - isiZulu to English38.6SSA-COMET (0-100; sentence-level zul->eng on the test split;21.4

Interactive version: theaggregate.ai/model?slug=tiny-aya-earth · How It Works · Data refreshed daily, snapshot 2026-11-20.