L3Cube-IndicQuest v2 (English) - Law: leaderboard

The 494 Law questions of L3Cube-IndicQuest v2 (L3Cube, 2026), India-specific factual questions from curricula and reference books answered closed-book in English and judged by Gemma 3 12B against the gold answer. Accuracy in percent; higher is better.

Metric: Accuracy (%; the 494 Law questions; closed-book short answers to curriculum-grounded India-specific factual questions in English, judged correct or incorrect by Gemma 3 12B against the gold answer (paraphrases and transliterations accepted)). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash89.7#453
2Gemma 4 31B50.8#394
3GPT-5.4 Mini45.1#389
4Sarvam 30B31.2#1744
5Llama 3.1 8B29.4#4861
6Gemma 2 9B26.9#2802

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=l3cube-indicquest-v2-english-law · How It Works · Data refreshed daily, snapshot 2026-11-13.