shisa-base-7B-v1: benchmark results
Provider: Other. Access: Open.
Unified ELO 1386 ± 31, rank #2242 of 2928 rated models, from 10 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - WinoGrande | 78.53 | Accuracy (%) (5-shot) | 63.8 |
| Open LLM Leaderboard v1 - GSM8K | 35.86 | Accuracy (%) (5-shot) | 51.4 |
| Open LLM Leaderboard v1 - HellaSwag | 77.63 | Normalized accuracy (%) (10-shot) | 31.4 |
| Open LLM Leaderboard v1 - ARC Challenge | 52.3 | Normalized accuracy (%) (25-shot) | 27 |
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 42.4 | MC2 (%) (0-shot) | 20.4 |
| pfgen-bench - Completion Mode - Helpfulness | 0.03 | Helpfulness Score | 19.8 |
| pfgen-bench - Completion Mode - Score | 0.3 | pfgen Score (mean of three) | 16 |
| pfgen-bench - Completion Mode - Truthfulness | 0.48 | Truthfulness Score | 15.8 |
| pfgen-bench - Completion Mode - Fluency | 0.38 | Fluency Score | 15 |
| Open LLM Leaderboard v1 - MMLU | 23.12 | Accuracy (%) (5-shot) | 1 |
Interactive version: theaggregate.ai/model?slug=shisa-base-7b-v1 · How It Works · Data refreshed daily, snapshot 2026-09-23.