LA Leaderboard - TE-ca: leaderboard

Textual entailment on Catalan sentence pairs (TE-ca). From the LA Leaderboard, which evaluates models on Spanish, Catalan, Basque and Galician tasks with the lm-evaluation-harness; accuracy (%), higher is better. Each model result file is a separate run.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 69 models tracked.

Top models

#ModelScoreOverall rank
1salamandra-7B-instruct53.19#1392
2Gemma 2 9B52.57#924
3EuroLLM-9B52.24#1238
4Gemma 2 9B (IT)52.15#795
5Qwen3-8B-Base51.72#626
6occiglot-7B-eu551.72
7Mistral-7B-v0.351.2#1321
8Llama 3.1 8B50.21#1130
9occiglot-7B-eu5-instruct50.12
10salamandra-7B50.07#1446
11EuroLLM-9B-Instruct48.94#1047
12Mistral 7B Instruct (v0.3)48.37#1255
13Teuken-7B-Instruct-v0.448.23#1408
14Qwen 2.5 7B47.95#895
15salamandra-2B-instruct47.85

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=la-leaderboard-te-ca · How It Works · Data refreshed daily, snapshot 2026-11-05.