NaijaS2ST - Speech Translation from English (Zero-Shot): leaderboard
NaijaS2ST (2026) pairs read speech in Hausa, Igbo, Yoruba and Nigerian Pidgin with English. Audio language models translate English speech into text in the four Nigerian languages, prompted zero-shot; SSA-COMET from 0 to 100 averaged over the four languages, higher is better.
Metric: SSA-COMET (0-100, COMET for African languages) of speech-to-text translation on the NaijaS2ST test set, English speech to Nigerian-language text, mean of Hausa, Igbo, Nigerian Pidgin and Yoruba; audio LLM prompted zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | NaijaS2ST Gemini 3.1 (checkpoint unspecified) | 67.3 | |
| 2 | Gemini 2.5 | 63.5 | |
| 3 | GPT-Audio | 40.3 | #607 |
| 4 | Gemma 4 | 37.6 |
Interactive version: theaggregate.ai/benchmark?slug=naijas2st-speech-translation-from-english-zero-shot · How It Works · Data refreshed daily, snapshot 2026-11-21.