Bangladesh Legal QA (No Law): leaderboard
This bilingual Bangladesh legal QA control set (North South University and BRAC University, 2026) also measures parametric statutory knowledge without supplied context, scored under strict consistency across all four option orders. Accuracy with no legal context supplied, in percent, higher is better.
Metric: Accuracy (%; no legal context supplied, parametric knowledge only; over 150 supplied-law control MCQs, strict consistency (correct in all four option orders); reference instruction-tuned model). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 3.5 4B | 76.7 | #1180 |
| 2 | Gemma 4 E2B | 70 | #4124 |
| 3 | Qwen 3.5 2B | 57.3 | #4849 |
| 4 | Llama 3.2 3B | 50.7 | #7877 |
| 5 | Qwen 3.5 0.8B | 38.7 | #8139 |
| 6 | Llama 3.2 1B | 28.7 | #9314 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=bangladesh-legal-qa-no-law · How It Works · Data refreshed daily, snapshot 2026-11-12.