Loading data...
Luciole-1B-Base: benchmark results
Provider: OpenLLM-France. Access: Open.
Aggregate Rating 1244 ± 32, rank #9156 of 10552 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - XNLI (English) (0-shot) | 53.8 | Accuracy (%), English benchmark | 61.1 |
| Lara Mini Base Report (base-model protocol) - Global PIQA (non-parallel), All Languages (0-shot) | 54 | Accuracy (%) averaged over all languages/variants of the ben | 33.3 |
| Lara Mini Base Report (base-model protocol) - CRUXEval-I (2-shot) | 25.9 | pass@1, direct prediction, official answer parser (%) | 22.2 |
| Lara Mini Base Report (base-model protocol) - HellaSwag (10-shot) | 62.5 | Accuracy normalized by answer length (%), English benchmark | 20.4 |
| Lara Mini Base Report (base-model protocol) - PIQA (0-shot) | 73.6 | Accuracy normalized by answer length (%), English benchmark | 20.4 |
| Lara Mini Base Report (base-model protocol) - WinoGrande (5-shot) | 61.7 | Accuracy (%), English benchmark | 20.4 |
| Lara Mini Base Report (base-model protocol) - Belebele, All Languages (0-shot) | 27.9 | Accuracy (%) averaged over all languages/variants of the ben | 19.4 |
| Lara Mini Base Report (base-model protocol) - PAWS-X, All Languages (0-shot) | 51.9 | Accuracy (%) averaged over all languages/variants of the ben | 19.4 |
| Lara Mini Base Report (base-model protocol) - XNLI, All Languages (0-shot) | 37.6 | Accuracy (%) averaged over all languages/variants of the ben | 19.4 |
| Lara Mini Base Report (base-model protocol) - COPA (0-shot) | 78.4 | Accuracy (%), English benchmark | 18.5 |
| Lara Mini Base Report (base-model protocol) - MBPP (3-shot) | 22.6 | pass@1 (execution) (%) | 18.5 |
| Lara Mini Base Report (base-model protocol) - T-HellaSwag, All Languages (0-shot) | 34.2 | Accuracy normalized by answer length (%) averaged over all l | 18.5 |
Interactive version: theaggregate.ai/model?slug=luciole-1b-base · How It Works · Data refreshed daily, snapshot 2026-11-16.