LA Leaderboard - CatCoLA: leaderboard

Metric: MCC (x100). Source: huggingface.co. 69 models tracked.

Top models

#ModelScore
1Gemma 2 9B (IT)22.32
2Gemma 2 9B16.3
3Gemma 3 4B (IT)14.66
4Qwen3-8B-Base11.19
5Mistral 7B Instruct (v0.3)9.73
6Llama 3.1 8B Instruct9.49
7Qwen 2.5 3B Instruct8.89
8aya-expanse-8B8.29
9Qwen 2.5 7B Instruct6.93
10SmolLM3-3B6.58
11OLMo-2-1124-7B-Instruct6.26
12Qwen 3 8B5.94
13Yi-1.5-9B Chat5.8
14Gemma 2 2B (IT)5.76
15Llama 3.1 8B5.21

Interactive version: theaggregate.ai/benchmark?slug=la-leaderboard-catcola · How It Works · Data refreshed daily, snapshot 2026-09-19.