LA Leaderboard - ClinDiagnosES: leaderboard

Spanish clinical cases for which the model writes the diagnosis (ClinDiagnosES). From the LA Leaderboard, which evaluates models on Spanish, Catalan, Basque and Galician tasks with the lm-evaluation-harness; semantic answer similarity, the cosine similarity of sentence embeddings x100, higher is better. Each model result file is a separate run.

Metric: Semantic Answer Similarity (x100). Source: huggingface.co. Saturation forecast: Estimated already saturated. 68 models tracked.

Top models

#ModelScoreOverall rank
1Gemma 2 9B (IT)66.38#795
2Gemma 3 4B (IT)65.33#997
3Qwen 2.5 7B Instruct64.16#863
4Teuken-7B-Instruct-v0.463.81#1408
5Llama 3.1 8B Instruct63.5#1017
6Gemma 2 2B (IT)62.78#1328
7EuroLLM-9B-Instruct61.81#1047
8Llama 3.1 8B61.41#1130
9salamandra-7B-instruct60.77#1392
10Mistral 7B Instruct (v0.3)60.27#1255
11Llama 3.2 3B Instruct60.21#1327
12OLMo-2-1124-7B-Instruct59.78#1343
13Teuken-7B-instruct-commercial-v0.459.73#1421
14occiglot-7B-eu5-instruct59.3
15Gemma 3 1B (IT)59.02#1481

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=la-leaderboard-clindiagnoses · How It Works · Data refreshed daily, snapshot 2026-11-05.