KrishokChat - Table QA (Oracle Context): leaderboard
KrishokChat (2026) tests LLMs on Bengali agricultural advice drawn from government publications, with questions in standard Bengali and five regional dialects. This board is token F1 in percent on questions over agricultural data tables given in context; higher is better.
Metric: Table QA token F1 (%) on 335 questions over Bengali agricultural tables (cell lookup, row reasoning, column aggregation) with the table given as grid Markdown, zero-shot with a standardized Bengali agricultural system prompt, no few-shot examples; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-OSS-120B | 55.86 | #700 |
| 2 | Qwen 2.5 7B Instruct | 38.09 | #2564 |
| 3 | Gemma 4 26B A4B (IT) | 27.78 | #549 |
| 4 | Llama 3.1 8B Instruct | 13.05 | #4246 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=krishokchat-table-qa-oracle-context · How It Works · Data refreshed daily, snapshot 2026-11-13.