Vibe-Bench - Full History - Preference MCC: leaderboard

Metric: Matthews Correlation (-1 to 1). Source: arxiv.org. Saturation forecast: Around December 2026. 6 models tracked.

Top models

#ModelScore
1Mistral Small 3.20.39
2Gemma 3 27B (IT)0.32
3Qwen 3 14B0.22
4Llama 3.1 70B Instruct0.21
5Qwen 3 235B A22B 2507 Instruct0.17
6Llama 3.1 8B Instruct0.05

Interactive version: theaggregate.ai/benchmark?slug=vibe-bench-full-history-preference-mcc · How It Works · Data refreshed daily, snapshot 2026-09-24.