Grip on LLMs - Dutch Simplification - INT Duidelijke Taal: leaderboard

Grip on LLMs (From Values to Benchmarks, arXiv 2608.09925v1, Appendix D), a Dutch governmental evaluation suite built with the City of Amsterdam. Dutch text simplification on INT Duidelijke Taal samples with crowdsourced accuracy above 70 whose simplification was rated simpler, SARI 0-100. Higher is better.

Metric: SARI (0-100). Source: arxiv.org. Saturation forecast: Not forecast. 31 models tracked.

Top models

#ModelScoreOverall rank
1GEITje-7B-ultra44.63#1435
2Mistral Large 343.15#410
3Gemma 3 27B (IT)42.86#528
4OLMo-2-0325-32B-Instruct42.29#847
5OLMo-2-1124-7B-Instruct41.28#1343
6Gemma 3 12B (IT)40.76#672
7aya-expanse-32B40.73#687
8GPT-4o40.19#357
9GPT-540.18#105
10EuroLLM-9B-Instruct39.62#1047
11Phi-4 Mini Instruct39.51#1232
12Qwen 3 32B39.1#449
13Llama 3.1 8B Instruct39#1017
14GPT-4o Mini38.9#598
15Qwen 3 8B38.68#678

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=grip-on-llms-dutch-simplification-int-duidelijke-taal · How It Works · Data refreshed daily, snapshot 2026-11-05.