K12-Bench - Chemistry: leaderboard

Metric: Chemistry subset, exact match (%, all-or-nothing over the selected option set) on four-option multi-select questions generated from the K12-KGraph curriculum knowledge graph of Chinese K-12 mathematics, physics, chemistry and biology textbooks; zero-shot, answer-only, temperature 0, all five tasks; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.

Top models

#ModelScore
1Gemini 3 Flash53.6
2Gemini 2.5 Flash45
3Gemma 4 31B (IT)44.1
4GPT-5.239.9
5Qwen 3 32B39.8
6GPT-5 Mini29.8
7GPT-4o29.2
8GLM-4.7 Flash28.8
9Llama 3 8B Instruct8.1

Interactive version: theaggregate.ai/benchmark?slug=k12-bench-chemistry · How It Works · Data refreshed daily, snapshot 2026-10-07.