KrishokChat - Treatment QA (Oracle Context): leaderboard
Metric: Treatment QA correct rate (%): the recommended treatment matches the provenance-tracked chemical, dosage and unit exactly (correct, omission or hallucination verdict against the chemical trace), 346 test questions in standard Bengali and five regional dialects across fertilizer, disease, pest, IPM, seed, food-safety and herbicide domains, zero-shot with a standardized Bengali agricultural system prompt, no few-shot examples, with the gold source passage in context; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemma 4 26B A4B (IT) | 54.05 |
| 2 | GPT-OSS-120B | 49.79 |
| 3 | Qwen 2.5 7B Instruct | 41.33 |
| 4 | Llama 3.1 8B Instruct | 30.64 |
Interactive version: theaggregate.ai/benchmark?slug=krishokchat-treatment-qa-oracle-context · How It Works · Data refreshed daily, snapshot 2026-09-29.