NaijaS2ST - Speech Translation from English (Zero-Shot): leaderboard
Metric: SSA-COMET (0-100, COMET for African languages) of speech-to-text translation on the NaijaS2ST test set, English speech to Nigerian-language text, mean of Hausa, Igbo, Nigerian Pidgin and Yoruba; audio LLM prompted zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | NaijaS2ST Gemini 3.1 (checkpoint unspecified) | 67.3 |
| 2 | Gemini 2.5 | 63.5 |
| 3 | GPT-Audio | 40.3 |
| 4 | Gemma 4 | 37.6 |
Interactive version: theaggregate.ai/benchmark?slug=naijas2st-speech-translation-from-english-zero-shot · How It Works · Data refreshed daily, snapshot 2026-10-07.