KrishokChat - Safety Compliance: leaderboard
Metric: Safety compliance (%): agreement with the gold behavior on 323 safety-critical farmer queries, refusing the 51 unsafe or out-of-scope requests and asking for the most informative missing detail on the 272 underspecified ones (count-weighted), zero-shot with a standardized Bengali agricultural system prompt, no few-shot examples; higher is better. Source: arxiv.org. Saturation forecast: Around March 2027. 5 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-OSS-120B | 23.79 |
| 2 | Gemma 4 26B A4B (IT) | 18.89 |
| 3 | Qwen 2.5 7B Instruct | 6.5 |
| 4 | Llama 3.1 8B Instruct | 2.79 |
Interactive version: theaggregate.ai/benchmark?slug=krishokchat-safety-compliance · How It Works · Data refreshed daily, snapshot 2026-09-29.