Nejumi 4 - GLP - Translation: leaderboard

Sentence translation in both directions between English and Japanese, on the Asian Language Treebank parallel corpus from the jaster harness. Each direction is scored with the learned COMET wmt22 metric against the reference translation and averaged over the 0-shot and 2-shot runs, and the board is the mean of the two directions on a 0 to 100 scale, higher is better. Source: github.com/wandb/llm-leaderboard.

Metric: Score (%). Source: nejumi.ai. Saturation forecast: Estimated already saturated. 139 models tracked.

Top models

#ModelScoreOverall rank
1Claude Fable 591.65#16
2Gemini 3.1 Pro (Preview)91.52#58
3GPT-5.6 Sol91.48#19
4GPT-5.5 (2026-04-23)91.47#22
5Gemini 3 Pro (Preview)91.44#66
6Gemini 3.5 Flash91.44#60
7Claude Opus 4.691.4#63
8Claude Opus 4.591.4#83
9Gemini 3.6 Flash91.4#51
10GPT-5.6 Terra91.38#41
11Claude Opus 4.791.37#49
12Claude Opus 491.37#163
13Gemini 3 Flash (Preview)91.36#82
14Claude Opus 4.191.36#140
15Claude Opus 591.34#12

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-glp-translation · How It Works · Data refreshed daily, snapshot 2026-10-20.