Loading data...
moe-7B-1B-active-shared-experts: benchmark results
Provider: ibm-research. Access: Open.
Aggregate Rating 1336 ± 34, rank #7991 of 10552 rated models, from 26 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
| Lara Mini Base Report (base-model protocol) - XNLI (English) (0-shot) | 55.8 | Accuracy (%), English benchmark | 92.6 |
| Lara Mini Base Report (base-model protocol) - COPA (0-shot) | 87.6 | Accuracy (%), English benchmark | 86.1 |
| Lara Mini Base Report (base-model protocol) - HellaSwag (10-shot) | 78.5 | Accuracy normalized by answer length (%), English benchmark | 85.2 |
| Lara Mini Base Report (base-model protocol) - WinoGrande (5-shot) | 72.4 | Accuracy (%), English benchmark | 72.2 |
| Lara Mini Base Report (base-model protocol) - MBPP+ (3-shot) | 53.2 | pass@1; must pass MBPP's own and the EvalPlus tests (%) | 68.5 |
| Lara Mini Base Report (base-model protocol) - PIQA (0-shot) | 78.7 | Accuracy normalized by answer length (%), English benchmark | 67.6 |
| Lara Mini Base Report (base-model protocol) - ARC-Challenge (25-shot) | 56.5 | Accuracy normalized by answer length (%), English benchmark | 61.1 |
| Lara Mini Base Report (base-model protocol) - MBPP (3-shot) | 45.2 | pass@1 (execution) (%) | 58.3 |
| Lara Mini Base Report (base-model protocol) - CRUXEval-O (2-shot) | 32.5 | pass@1, direct prediction, official answer parser (%) | 50.9 |
| Lara Mini Base Report (base-model protocol) - PAWS (English) (0-shot) | 65 | Accuracy (%), English benchmark | 50 |
| Lara Mini Base Report (base-model protocol) - PAWS-X, All Languages (0-shot) | 54.6 | Accuracy (%) averaged over all languages/variants of the ben | 47.2 |
| Lara Mini Base Report (base-model protocol) - GSM8K (5-shot) | 54.9 | Exact match (strict extraction: first "#### N", else first \ | 46.3 |
Interactive version: theaggregate.ai/model?slug=moe-7b-1b-active-shared-experts · How It Works · Data refreshed daily, snapshot 2026-11-16.