CAST (Discourse Stress) - Text-Only Pair-Correct: leaderboard

Metric: Pair-correct rate (%): pairs where both contexts get their intended stressed word; 113 contrastive context pairs (226 items) in which one sentence must stress a different word under each of its two contexts; text-only models name the stressed word zero-shot, non-thinking mode; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 4 models tracked.

Top models

#ModelScore
1Claude Haiku 4.576.1
2Qwen 3 4B (Non-reasoning)37.2
3Qwen 3 1.7B (Non-reasoning)24.8
4Qwen 3 0.6B (Non-reasoning)5.3

Interactive version: theaggregate.ai/benchmark?slug=cast-discourse-stress-text-only-pair-correct · How It Works · Data refreshed daily, snapshot 2026-10-07.