EDCT-Bench (Binary): leaderboard
Metric: Counterfactual Consistency Score, binary (%; mean over cited concepts of answer-consistency times explanation-faithfulness after verified minimal image edits, k=2, Qwen3-235B-A22B extractor and judge, FLUX.2 Max editor). Source: arxiv.org. Saturation forecast: Around January 2027. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Flash (Thinking) | 60 |
| 2 | GLM-4.6V (Reasoning) | 57 |
| 3 | Qwen 3 VL 8B Instruct | 51 |
| 4 | Pixtral-12B | 47 |
| 5 | Gemma 3 27B | 44 |
Interactive version: theaggregate.ai/benchmark?slug=edct-bench-binary · How It Works · Data refreshed daily, snapshot 2026-09-26.