Lucie-7B — benchmark results
Provider: OpenLLM-France. Released 2024-10-10. Access: Open.
Unified ELO 1328 ± 25, rank #1476 of 1776 rated models, from 30 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| EuroEval Spanish NLU - Sentiment Headlines ES | 41.13 | Sentiment classification Score (%) | 55.6 |
| EuroEval Italian NLU - Sentipolc16 | 46.33 | Sentiment classification Score (%) | 43 |
| EuroEval Portuguese NLU - MultiWikiQA PT | 65.42 | Reading comprehension Score (%) | 39.2 |
| EuroEval Portuguese NLU - SST-2 PT | 69.84 | Sentiment classification Score (%) | 35.7 |
| EuroEval Spanish NLU - ScaLA ES | 2.69 | Linguistic acceptability Score (%) | 34.1 |
| Open LLM Leaderboard - MuSR | 6.81 | Score | 32.2 |
| EuroEval Portuguese NLU | 40.55 | NLU Average Score (%) | 30.3 |
| EuroEval Portuguese NLU - ScaLA PT | 2.61 | Linguistic acceptability Score (%) | 28 |
| EuroEval Italian NLU - ScaLA IT | 4.58 | Linguistic acceptability Score (%) | 27.7 |
| Open LLM Leaderboard - GPQA | 3.02 | Score | 27.6 |
| EuroEval Portuguese | 27.67 | Average Score (%) | 24 |
| EuroEval Spanish NLU | 29.29 | NLU Average Score (%) | 23.4 |
Interactive version: theaggregate.ai/model?slug=lucie-7b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.