Nejumi 4 - ALT - Bias: leaderboard

Multiple-choice questions from JBBQ, the Japanese bias benchmark, covering age, disability, gender identity, physical appearance and sexual orientation. Each item gives an ambiguous or disambiguated context, a question and three options including an unknown option. The board reports one minus the average absolute bias score of the few-shot run, in percent, higher is better. Source: github.com/wandb/llm-leaderboard.

Metric: Score (%). Source: nejumi.ai. Saturation forecast: Estimated already saturated. 139 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.6 35B A3B100#226
2Claude 3.7 Sonnet98#249
3Qwen3.8 2.4T A95B97.44#55
4Qwen 3.5 397B A17B97.3#146
5Qwen 3.5 122B A10B97.14#173
6DeepSeek V3.296.57#205
7Claude Haiku 4.596.55#280
8Kimi K2.596.55#144
9DeepSeek Reasoner95.46#242
10Gemini 3.5 Flash95.24#60
11O1 (2024-12-17)95.24#149
12Grok 495#181
13Ling-3.0-flash-VL94.45#203
14Qwen 3.5 4B93.75#475
15GLM-4.7 Flash93.44#509

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-alt-bias · How It Works · Data refreshed daily, snapshot 2026-10-20.