LA Leaderboard - NoticIA: leaderboard

Summarising Spanish clickbait news articles in one sentence that resolves the headline (NoticIA). From the LA Leaderboard, which evaluates models on Spanish, Catalan, Basque and Galician tasks with the lm-evaluation-harness; ROUGE-1 (%), higher is better. Each model result file is a separate run.

Metric: ROUGE-1 (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 69 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 2 9B (IT)34.11#795
2Qwen 2.5 7B Instruct31.47#863
3Llama 3.1 8B Instruct28.71#1017
4Qwen 2.5 3B Instruct28.36#1159
5Mistral 7B Instruct (v0.3)27.44#1255
6EuroLLM-9B-Instruct26.8#1047
7Gemma 2 2B (IT)25.7#1328
8Llama 3.2 3B Instruct25.4#1327
9Gemma 3 4B (IT)23.93#997
10OLMo-2-1124-7B-Instruct23.29#1343
11occiglot-7B-eu5-instruct23.08
12Qwen 2.5 1.5B Instruct22.07#1393
13Yi-1.5-9B Chat21.49#1032
14Teuken-7B-Instruct-v0.420.37#1408
15salamandra-7B-instruct19.38#1392

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=la-leaderboard-noticia · How It Works · Data refreshed daily, snapshot 2026-11-05.