AfriScience-MT (Zero-Shot) - Amharic to English: leaderboard

Metric: SSA-COMET (0-100; sentence-level amh->eng on the test split; zero-shot). Source: arxiv.org. Saturation forecast: Around June 2027. 15 models tracked.

Top models

#ModelScore
1GPT-5.469.1
2Gemini 1.5 Flash62.6
3GPT-4o60.5
4Gemini 3.1 Flash Lite58.7
5Llama 3.1 8B Instruct42.3
6Gemma 2 9B (IT)41.1
7Tiny Aya Global40.8

Interactive version: theaggregate.ai/benchmark?slug=afriscience-mt-zero-shot-amharic-to-english · How It Works · Data refreshed daily, snapshot 2026-09-26.