speechless-code-mistral-7B-v1.0: benchmark results
uukuguy's speechless-code-mistral 7B v1.0, a Mistral 7B fine-tune on about 202,000 coding, reasoning and planning samples from six datasets. Provider: uukuguy. Released 2023-10-10. Access: Open.
Aggregate Rating 1372 ± 29, rank #1328 of 1656 rated models, from 20 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - MuSR | 45.02 | Score | 83.4 |
| Open Portuguese LLM - ASSIN2 RTE | 91.3 | Macro F1 (%) | 66.1 |
| Open Portuguese LLM - OAB Exams | 45.69 | Accuracy (%) | 61.9 |
| Open Portuguese LLM - ENEM | 62.98 | Accuracy (%) | 54.1 |
| Open Portuguese LLM - BLUEX | 51.32 | Accuracy (%) | 49.2 |
| Open Portuguese LLM - FaQuAD NLI | 60.12 | Macro F1 (%) | 44.4 |
| Open LLM Leaderboard - MMLU-Pro | 31.46 | Score | 42 |
| Open LLM Leaderboard - GPQA | 28.44 | Score | 39.4 |
| EvalPlus (HumanEval+ & MBPP+) | 45.1 | Pass@1 avg (%) | 38.7 |
| Open LLM Leaderboard - BBH | 45.72 | Score | 35.6 |
| Open LLM Leaderboard - IFEval | 36.65 | Score | 35.2 |
| Open LLM Leaderboard - MATH Level 5 | 5.21 | Score | 29.1 |
Interactive version: theaggregate.ai/model?slug=speechless-code-mistral-7b-v1-0 · How It Works · Data refreshed daily, snapshot 2026-10-20.