LongChat-7B-v1.5-32k: benchmark results
Provider: LMSYS. Released 2023-08-01. Access: Open.
Aggregate Rating 1266 ± 12, rank #1506 of 1640 rated models, from 80 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - Abstract Algebra | 34 | Accuracy (%) | 82 |
| MMLU-by-task - High School Mathematics | 30.74 | Accuracy (%) | 81.5 |
| MMLU-by-task - College Mathematics | 35 | Accuracy (%) | 75 |
| MMLU-by-task - Elementary Mathematics | 31.75 | Accuracy (%) | 65.7 |
| MMLU-by-task - Machine Learning | 34.82 | Accuracy (%) | 60.8 |
| MMLU-by-task - High School European History | 63.03 | Accuracy (%) | 56.5 |
| MMLU-by-task - TruthfulQA MC1 | 29.38 | Accuracy (%) | 54.6 |
| MMLU-by-task - High School Statistics | 39.81 | Accuracy (%) | 54.3 |
| MMLU-by-task - High School US History | 62.25 | Accuracy (%) | 54.2 |
| MMLU-by-task - High School Geography | 57.58 | Accuracy (%) | 53 |
| MMLU-by-task - Clinical Knowledge | 48.3 | Accuracy (%) | 51.5 |
| MMLU-by-task - High School Chemistry | 33.99 | Accuracy (%) | 51 |
Interactive version: theaggregate.ai/model?slug=longchat-7b-v1-5-32k · How It Works · Data refreshed daily, snapshot 2026-11-07.