ALBA - Discourse Analysis: leaderboard

Metric: Mean judge score (0-100) on ALBA's 100 expert-written pt-PT discourse analysis questions (analyzing and adapting texts: register, text type, figures of speech, paraphrase, reported speech and proofreading), judged by Gemini-2.5-Pro with an expert pt-PT rubric (precision, linguistic quality, completeness), three expert-rated few-shot examples and greedy decoding, 1-5 rating rescaled to 0-100; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked.

Top models

#ModelScoreOverall rank
1GPT-598.5#91
2Gemini 2.5 Pro98#145
3Gemma 3 12B (IT)85.5#655
4Gemma 2 9B (IT)78.5#774
5Qwen 3 8B77.5#667
6Apertus-8B-Instruct-250970.3#1048
7EuroLLM-9B-Instruct67#1043
8Qwen 2.5 7B Instruct63#846
9Ministral-8B-Instruct-241061#1080
10Llama 3.1 8B Instruct60.5#1018
11salamandra-7B-instruct52.8#1390
12Mistral 7B Instruct50#1345
13OLMo-2-1124-7B-Instruct43.3#1349

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=alba-discourse-analysis · How It Works · Data refreshed daily, snapshot 2026-10-11.