LA Leaderboard - ClinTreatES: leaderboard

Spanish clinical cases for which the model writes the treatment (ClinTreatES). From the LA Leaderboard, which evaluates models on Spanish, Catalan, Basque and Galician tasks with the lm-evaluation-harness; semantic answer similarity, the cosine similarity of sentence embeddings x100, higher is better. Each model result file is a separate run.

Metric: Semantic Answer Similarity (x100). Source: huggingface.co. Saturation forecast: Estimated already saturated. 68 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 7B Instruct67.46#863
2Gemma 3 4B (IT)65.6#997
3Qwen 2.5 1.5B Instruct65.27#1393
4Mistral 7B Instruct (v0.3)65.24#1255
5Yi-1.5-9B Chat64.88#1032
6salamandra-7B-instruct64.07#1392
7occiglot-7B-eu5-instruct63.93
8Qwen 2.5 7B63.8#895
9Gemma 3 1B (IT)63.7#1481
10Gemma 2 9B (IT)62.83#795
11Llama 3.1 8B62.41#1130
12Qwen 2.5 3B61.88#1177
13Gemma 2 9B61.87#924
14Teuken-7B-instruct-commercial-v0.461.68#1421
15SmolLM2-1.7B-Instruct60.81#1541

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=la-leaderboard-clintreates · How It Works · Data refreshed daily, snapshot 2026-11-05.