LiveK12Bench - Chemistry: leaderboard

Final-answer accuracy (%) on the chemistry questions of LiveK12Bench (2026), a live benchmark of recent Chinese high-school examination papers in text, text-image and full-page formats, checked by a panel of LLM judges; higher is better.

Metric: Answer accuracy (%), pass@1 on the final answer, Chemistry questions, LiveK12Bench 2026-03 split of recent Chinese high-school exam papers, unified answer prompt, answers checked by a panel of three LLM judges that never grade their own model; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 12 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1Gemini 3 Flash80.7#175
2Gemini 3 Pro79.4#145
3Kimi K2.577.2#266
4Claude Opus 4.677#113
5Qwen 3 VL 235B A22B74.3#485
6Claude Sonnet 4.673.8#173
7Qwen 3 VL 32B73.8#622
8GLM-565.1#269
9Qwen 3 VL 8B62.2#917
10GPT-559.3#178
11GPT-5 Mini45.2#364
12GPT-4o29.4#751

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=livek12bench-chemistry · How It Works · Data refreshed daily, snapshot 2026-11-21.