Voice of India - Marathi: leaderboard
Speech recognition on the Marathi part of Voice of India (2026), a closed benchmark of unscripted telephone conversations in Indian languages, scored with an orthographically informed word error rate that accepts permissible spelling variants. Percent, can exceed 100; lower is better.
Metric: Orthographically informed word error rate (OIWER, %; can exceed 100) on the Marathi unscripted telephone-conversation utterances of the closed Voice of India benchmark, transcripts with lattices of permissible spelling variants; systems run at default inference settings and only where they support the language; lower is better. Source: arxiv.org. Saturation forecast: Around March 2028. 14 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Sarvam Audio | 9.4 | |
| 2 | Saarika 2.5 | 10 | |
| 3 | Gemini 3 Pro | 10.7 | #145 |
| 4 | Amazon Transcribe | 11.3 | |
| 5 | elevenlabs-scribe_v2 | 12.9 | |
| 6 | IndicConformer | 13.1 | |
| 7 | Gemini 3 Flash | 16 | #175 |
| 8 | omniASR_LLM_7B | 26.3 | |
| 9 | gpt-4o-mini-transcribe | 30.7 | |
| 10 | omniASR_LLM_1B | 31.2 | |
| 11 | Microsoft Speech-to-Text | 31.9 | |
| 12 | Deepgram Nova 3 | 43.7 | |
| 13 | GPT-4o Transcribe | 55.6 | |
| 14 | AssemblyAI Universal | 87.6 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=voice-of-india-marathi · How It Works · Data refreshed daily, snapshot 2026-11-21.