Gakucho Benchmark - Science Open-Ended: leaderboard

The Gakucho Benchmark (2026) is built from the officially released Grade 9 items of the 2022 Japanese National Assessment of Academic Ability, keeping the original layouts, diagrams and nationwide student response statistics. This board scores the answers to the open-ended Science items by character-level F1 against the official answers, on a 0-100 scale; higher is better.

Metric: Character-level F1 (0-100, the paper's 0-1 score times 100) of the answers to the 10 open-ended Science items against the official correct answers, of the officially released Grade 9 items of Japan's 2022 National Assessment of Academic Ability (original exam layouts and diagrams, Japanese prompts, nationwide student response statistics), zero-shot with the item images; higher is better. Source: arxiv.org. Saturation forecast: Around 2028. 11 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash66.1#466
2Claude Sonnet 4 (20250514)54.8#410
3Claude Sonnet 4.552.1#267
4Gemini 2.5 Pro49.8#280
5GPT-548.9#185
6Claude 3.7 Sonnet44.7#455
7GPT-4o39.9#754
8GPT-4o Mini37.9#1680
9Qwen 2.5 VL 7B Instruct34.9#1919
10Gemma 3 12B (IT)32.9#1907
11Gemini 3.1 Pro (Preview)32.4#102

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=gakucho-benchmark-science-open-ended · How It Works · Data refreshed daily, snapshot 2026-11-22.