Voice of India - Hindi: leaderboard

Speech recognition on the Hindi part of Voice of India (2026), a closed benchmark of unscripted telephone conversations in Indian languages, scored with an orthographically informed word error rate that accepts permissible spelling variants. Percent, can exceed 100; lower is better.

Metric: Orthographically informed word error rate (OIWER, %; can exceed 100) on the Hindi unscripted telephone-conversation utterances of the closed Voice of India benchmark, transcripts with lattices of permissible spelling variants; systems run at default inference settings and only where they support the language; lower is better. Source: arxiv.org. Saturation forecast: Around March 2028. 14 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Sarvam Audio5
2Gemini 3 Pro6#145
3Saarika 2.56.2
4Amazon Transcribe6.8
5elevenlabs-scribe_v27.7
6IndicConformer8.2
7Gemini 3 Flash8.3#175
8Microsoft Speech-to-Text11.4
9Deepgram Nova 313
10omniASR_LLM_7B13.7
11omniASR_LLM_1B14.9
12AssemblyAI Universal19.3
13gpt-4o-mini-transcribe19.6
14GPT-4o Transcribe33.9

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=voice-of-india-hindi · How It Works · Data refreshed daily, snapshot 2026-11-21.