Lucie-7B-Instruct-v1.1: benchmark results
Provider: OpenLLM-France. Access: Open.
Aggregate Rating 1291 ± 31, rank #8859 of 10916 rated models, from 46 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| CARTE - Occitanie | 49.6 | Accuracy (%) on the 139 CARTE questions about Occitanie, 0-s | 53.8 |
| CARTE - Nouvelle-Aquitaine | 46.1 | Accuracy (%) on the 180 CARTE questions about Nouvelle-Aquit | 51.9 |
| CARTE - Bretagne | 55.9 | Accuracy (%) on the 145 CARTE questions about Bretagne, 0-sh | 50 |
| CARTE - France (National) | 56.2 | Accuracy (%) on the 192 CARTE questions about national-level | 50 |
| CARTE - Grand Est | 53 | Accuracy (%) on the 217 CARTE questions about Grand Est, 0-s | 50 |
| CARTE - Ile-de-France | 59 | Accuracy (%) on the 273 CARTE questions about Ile-de-France, | 48.1 |
| CARTE - Provence-Alpes-Cote d'Azur | 47.3 | Accuracy (%) on the 224 CARTE questions about Provence-Alpes | 46.2 |
| CARTE | 47.4 | Accuracy (%) on all 2,431 CARTE questions (question-weighted | 42.3 |
| CARTE - Hauts-de-France | 52 | Accuracy (%) on the 125 CARTE questions about Hauts-de-Franc | 42.3 |
| CARTE - Bourgogne-Franche-Comte | 45.1 | Accuracy (%) on the 203 CARTE questions about Bourgogne-Fran | 38.5 |
| CARTE - Centre-Val de Loire | 36.8 | Accuracy (%) on the 136 CARTE questions about Centre-Val de | 38.5 |
| CARTE - Pays de la Loire | 32.3 | Accuracy (%) on the 133 CARTE questions about Pays de la Loi | 38.5 |
Interactive version: theaggregate.ai/model?slug=lucie-7b-instruct-v1-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.