Neo-Classic - Quatrain Line Ordering: leaderboard

Metric: Accuracy (%; restore the order of the four shuffled lines of a contemporary quatrain (Jue); accuracy on a 100-question sample of the task, as reported in the paper's full results table (accuracy@IF); temperature 0.1, top-p 0.9). Source: arxiv.org. Saturation forecast: Around August 2027. 8 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)41
2Qwen 3 Max32
3DeepSeek V3.227.4
4Gemini 2.5 Pro19
5GPT-4o16.2
6Yi 1.5 34B Chat9

Interactive version: theaggregate.ai/benchmark?slug=neo-classic-quatrain-line-ordering · How It Works · Data refreshed daily, snapshot 2026-09-26.