Neo-Classic - Regulated Verse Line Ordering (CoT, Expert Prompt): leaderboard

Metric: Accuracy (%; restore the order of the eight shuffled lines of a contemporary regulated verse (Lyu) with an expert chain-of-thought prompt describing rhyme, parallelism and discourse checks; accuracy on a 100-question sample of the task, as reported in the paper's full results table (accuracy@IF); temperature 0.1, top-p 0.9). Source: arxiv.org. Saturation forecast: Around December 2026. 9 models tracked.

Top models

#ModelScore
1Gemini 3 Pro (Preview)36
2GPT-5 Pro24
3DeepSeek V3.213.8
4Qwen 3 Max13
5Gemini 2.5 Pro8
6GPT-4o0
7Yi 1.5 34B Chat0

Interactive version: theaggregate.ai/benchmark?slug=neo-classic-regulated-verse-line-ordering-cot-expert-prompt · How It Works · Data refreshed daily, snapshot 2026-09-26.