Kaggle IndicGenBench: leaderboard

Google DeepMind's IndicGenBench on Kaggle: text generation in up to 29 Indic languages across cross-lingual summarization, translation and two question-answering tasks. This board is Kaggle's unweighted average of the four task scores, kept only for models with all four; it mixes ChrF and token-F1 points (0-100, higher is better).

Metric: Average Score. Source: www.kaggle.com. Saturation forecast: Around June 2027. 12 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.560.65#148
2Gemini 3 Pro (Preview)59.89#71
3Gemini 2.5 Flash56.92#255
4Claude Opus 4.154.96#146
5GPT-552.23#105
6Grok 452.03#189
7O349.97#132
8Qwen 3 235B A22B 2507 Instruct48.91#315
9GPT-4.143.66#258
10O4 Mini41.85#185
11GPT-OSS-120B39.12#346
12Sarvam M37.16#643

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=kaggle-indicgenbench · How It Works · Data refreshed daily, snapshot 2026-11-05.