AfriScience-MT (Zero-Shot) - English to isiZulu: leaderboard

Metric: SSA-COMET (0-100; sentence-level eng->zul on the test split; zero-shot). Source: arxiv.org. Saturation forecast: Around June 2027. 15 models tracked.

Top models

#ModelScore
1GPT-5.463.2
2GPT-4o58.3
3Gemini 1.5 Flash53.9
4Gemini 3.1 Flash Lite52.2
5Gemma 2 9B (IT)36.8
6Tiny Aya Global33.2
7Llama 3.1 8B Instruct27.1

Interactive version: theaggregate.ai/benchmark?slug=afriscience-mt-zero-shot-english-to-isizulu · How It Works · Data refreshed daily, snapshot 2026-09-26.