Nejumi 4 - GLP - Abstract Reasoning: leaderboard

Grid puzzles from ARC-AGI-1 and ARC-AGI-2: the model sees a few demonstration input and output grids, infers the transformation and writes the output grid for a new input. Nejumi uses 50 tasks from each public evaluation set, with Japanese system prompts and the original numeric grids, and averages the two accuracies in percent where higher is better. Source: github.com/wandb/llm-leaderboard.

Metric: Score (%). Source: nejumi.ai. Saturation forecast: Around January 2027. 139 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.6 Terra98#41
2GPT-5.6 Sol97#19
3Claude Opus 596#12
4Claude Fable 593#16
5GPT-5.5 (2026-04-23)93#22
6GPT-5.4 (2026-03-05)91#59
7Qwen3.8 2.4T A95B90#55
8Claude Opus 4.887#37
9Claude Opus 4.685#63
10Gemini 3.6 Flash84#51
11Gemini 3.1 Pro (Preview)83#58
12Claude Opus 4.783#49
13Hy4 preview83#38
14DeepSeek V4.1 Flash81#36
15Grok 4.20 0309 (Reasoning)81#112 (Grok 4.20 0309)

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-glp-abstract-reasoning · How It Works · Data refreshed daily, snapshot 2026-10-20.