AfriScience-MT (Zero-Shot) - English to Amharic: leaderboard

Metric: SSA-COMET (0-100; sentence-level eng->amh on the test split; zero-shot). Source: arxiv.org. Saturation forecast: Around June 2027. 15 models tracked.

Top models

#ModelScore
1GPT-5.461.7
2Gemini 1.5 Flash57.9
3Gemini 3.1 Flash Lite55.6
4GPT-4o39.4
5Gemma 2 9B (IT)35.7
6Tiny Aya Global26.8
7Llama 3.1 8B Instruct21.6

Interactive version: theaggregate.ai/benchmark?slug=afriscience-mt-zero-shot-english-to-amharic · How It Works · Data refreshed daily, snapshot 2026-09-26.