Grip on LLMs - Dutch Simplification - Amsterdam: leaderboard

Grip on LLMs (From Values to Benchmarks, arXiv 2608.09925v1, Appendix D), a Dutch governmental evaluation suite built with the City of Amsterdam. Dutch text simplification of sentence pairs from City of Amsterdam public communications, scored with SARI against reference simplifications, 0-100. Higher is better.

Metric: SARI (0-100). Source: arxiv.org. Saturation forecast: Not forecast. 31 models tracked.

Top models

#ModelScoreOverall rank
1GEITje-7B-ultra46.91#1435
2OLMo-2-0325-32B-Instruct45.14#847
3Mistral Large 344.25#410
4OLMo-2-1124-7B-Instruct43.47#1343
5Gemma 3 27B (IT)43.34#528
6Phi-4 Mini Instruct42.48#1232
7aya-expanse-32B42.39#687
8EuroLLM-9B-Instruct41.93#1047
9Llama 3.1 8B Instruct41.88#1017
10GPT-4o41.63#357
11GPT-541.3#105
12Mistral 7B Instruct (v0.3)40.93#1255
13Mistral Medium 340.46#507
14Gemma 3 12B (IT)40.45#672
15Qwen 3 8B40.13#678

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=grip-on-llms-dutch-simplification-amsterdam · How It Works · Data refreshed daily, snapshot 2026-11-05.