NaijaS2ST - Speech Translation from English (Few-Shot): leaderboard
NaijaS2ST (2026) pairs read speech in Hausa, Igbo, Yoruba and Nigerian Pidgin with English. Audio language models translate English speech into text in the four Nigerian languages, prompted with few-shot examples; SSA-COMET from 0 to 100 averaged over the four languages, higher is better.
Metric: SSA-COMET (0-100, COMET for African languages) of speech-to-text translation on the NaijaS2ST test set, English speech to Nigerian-language text, mean of Hausa, Igbo, Nigerian Pidgin and Yoruba; audio LLM prompted with few-shot examples; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | NaijaS2ST Gemini 3.1 (checkpoint unspecified) | 67.7 | |
| 2 | Gemini 2.5 | 63 | |
| 3 | GPT-Audio | 61.5 | #594 |
| 4 | Gemma 4 | 38.2 |
Interactive version: theaggregate.ai/benchmark?slug=naijas2st-speech-translation-from-english-few-shot · How It Works · Data refreshed daily, snapshot 2026-11-22.