BDBBQ Certified - BanglaLLM ChatML - eng_acc_ambig: leaderboard
BDBBQ official certified2026-10-30JSON,30656questions perlanguage,61312permodel,English/Bengali andoverall/ambiguous/disambiguated cohorts explicit. BF16,L40S,vLLM,context2048,temp0. Seven nativechatmodels16tokens;BanglaLLM ChatML is separate from paperplaincompletion5tokens and is not substituted. Ambiguous correctunknown;disambiguated factualgold,invalidoutputwrong,answerpermutationsseparaterecords,nomajorityvote. Accuracy only; signedbias and parsefailrates are diagnostics.
Metric: Score (%). Source: raw.githubusercontent.com. 1 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Bangla-s1k-qwen-2.5-3B-Instruct | 19.53 |
Interactive version: theaggregate.ai/benchmark?slug=bdbbq-certified-banglallm-chatml-eng-acc-ambig · How It Works · Data refreshed daily, snapshot 2026-11-12.