IndicContextEval: leaderboard
IndicContextEval (2026) tests speech recognition by audio language models on 56 hours of natural read and extempore speech from 555 speakers in eight Indian languages and 23 professional domains, with transcripts in the native script. This board is word error rate in percent when the prompt gives only the target language; lower is better.
Metric: Word error rate (%), averaged over the benchmark, with only the target language given in the prompt (L1); 56 hours of natural read and extempore speech from 555 speakers in 8 Indian languages (Hindi, Bengali, Telugu, Marathi, Gujarati, Malayalam, Odia, Urdu) and 23 professional domains, native-script output; lower is better. Source: arxiv.org. Saturation forecast: Around August 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3 Flash | 18.9 | #164 |
| 2 | Gemma 3n E4B | 38.73 | #3301 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=indiccontexteval · How It Works · Data refreshed daily, snapshot 2026-11-13.