KVBench (Brief Caption) - Chemistry (English): leaderboard
KVBench (2026) tests whether text-to-image models can draw correct senior high-school chemistry content, such as diagrams and scientific illustrations, from English prompts given as a brief caption, so the model must supply the textbook knowledge itself. Qwen2.5-VL-32B checks each image against a list of textbook-grounded constraints; the score is the percentage satisfied, higher is better.
Metric: Checklist score (%) on the chemistry prompts in English, each given as a brief caption, so the model must supply the textbook knowledge itself: KVBench knowledge-intensive text-to-image prompts from over 30 senior high-school textbooks (150 per subject and language, each with a textbook reference image); Qwen2.5-VL-32B-Instruct answers a checklist of four to six binary questions (key objects, attributes, spatial relations, reasoning outcomes) about each generated image, and the score is the mean share of satisfied items, in percent; higher is better. Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 14 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-Image (KVBench checkpoint unspecified) | 51.6 | |
| 2 | Nano Banana Pro (Gemini 3 Pro Image) | 50.4 | |
| 3 | Seedream 4.0 | 49 | |
| 4 | FLUX 2 Max | 45.2 | |
| 5 | FLUX.1-dev | 41.13 | |
| 6 | FLUX.2-dev | 38.73 | |
| 7 | SD3.5-Large (KVBench GGUF build, quantization unspecified) | 36.53 | |
| 8 | Janus-Pro | 27.07 | |
| 9 | Show-o2 | 26.67 | |
| 10 | BAGEL-7B-MoT | 23.73 | #4619 |
| 11 | Z-Image | 23.67 | |
| 12 | Qwen-Image | 23.53 | |
| 13 | OmniGen2 | 21.8 | #4579 |
| 14 | FLUX.1-Krea-dev | 18.4 |
Interactive version: theaggregate.ai/benchmark?slug=kvbench-brief-caption-chemistry-english · How It Works · Data refreshed daily, snapshot 2026-11-21.