CARTE - Centre-Val de Loire: leaderboard

Metric: Accuracy (%) on the 136 CARTE questions about Centre-Val de Loire, 0-shot, five options per question (four answers and 'Je ne sais pas', which scores as wrong); questions generated by Gemini 3 Flash from human-selected French documents and filtered; higher is better. Source: arxiv.org. Saturation forecast: Around December 2026. 27 models tracked.

Top models

#ModelScore
1Gemini 3 Flash89.9
2Gemma 3 12B (IT)72.1
3Llama 3.1 8B Instruct69.1
4Qwen 3.5 9B68.4
5Mistral Nemo Instruct (2407)66.2
6aya-expanse-8B63.2
7Qwen 3.5 4B61
8Mistral 7B Instruct (v0.3)57.4
9Mistral 7B Instruct (v0.2)53.7
10Llama 3.2 3B Instruct44.9
11Llama 3.2 1B Instruct41.9
12Luth-LFM2-1.2B33.8
13Lucie-7B32.4
14Mistral-7B-v0.127.2
15Gaperon-1125-1B-SFT19.9

Interactive version: theaggregate.ai/benchmark?slug=carte-centre-val-de-loire · How It Works · Data refreshed daily, snapshot 2026-09-29.