CARTE - Corse: leaderboard

Metric: Accuracy (%) on the 100 CARTE questions about Corse (Corsica), 0-shot, five options per question (four answers and 'Je ne sais pas', which scores as wrong); questions generated by Gemini 3 Flash from human-selected French documents and filtered; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 27 models tracked.

Top models

#ModelScore
1Gemini 3 Flash98.8
2Mistral Nemo Instruct (2407)85
3Qwen 3.5 9B82
4Gemma 3 12B (IT)80
5Llama 3.1 8B Instruct79
6aya-expanse-8B79
7Qwen 3.5 4B77
8Mistral 7B Instruct (v0.3)76
9Mistral 7B Instruct (v0.2)73
10Llama 3.2 3B Instruct70
11Llama 3.2 1B Instruct59
12Luth-LFM2-1.2B56
13Lucie-7B51
14Mistral-7B-v0.131
15CroissantLLMChat-v0.118

Interactive version: theaggregate.ai/benchmark?slug=carte-corse · How It Works · Data refreshed daily, snapshot 2026-09-29.