AfriScience-MT (Zero-Shot) - Northern Sotho to English: leaderboard

Metric: SSA-COMET (0-100; sentence-level nso->eng on the test split; zero-shot). Source: arxiv.org. Saturation forecast: Around June 2027. 15 models tracked.

Top models

#ModelScore
1GPT-5.469.5
2GPT-4o62
3Gemini 3.1 Flash Lite60.2
4Gemini 1.5 Flash59.8
5Gemma 2 9B (IT)42.7
6Llama 3.1 8B Instruct41
7Tiny Aya Global36.9

Interactive version: theaggregate.ai/benchmark?slug=afriscience-mt-zero-shot-northern-sotho-to-english · How It Works · Data refreshed daily, snapshot 2026-09-26.