firefly-llama2-7B-chat-temp: benchmark results
Provider: Other.
Aggregate Rating 1275 ± 17, rank #9019 of 10916 rated models, from 62 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| MMLU-by-task - College Mathematics | 39 | Accuracy (%) | 92.7 |
| MMLU-by-task - Machine Learning | 41.96 | Accuracy (%) | 84.6 |
| MMLU-by-task - Abstract Algebra | 33 | Accuracy (%) | 75.6 |
| MMLU-by-task - High School Physics | 33.77 | Accuracy (%) | 75 |
| MMLU-by-task - Public Relations | 60 | Accuracy (%) | 65.9 |
| MMLU-by-task - High School Mathematics | 28.52 | Accuracy (%) | 64.7 |
| MMLU-by-task - TruthfulQA MC1 | 31.46 | Accuracy (%) | 64.5 |
| MMLU-by-task - Business Ethics | 52 | Accuracy (%) | 61.8 |
| MMLU-by-task - College Computer Science | 42 | Accuracy (%) | 61.2 |
| MMLU-by-task - Virology | 42.77 | Accuracy (%) | 60.3 |
| MMLU-by-task - TruthfulQA MC2 | 46.78 | Accuracy (%) | 58.6 |
| MMLU-by-task - Sociology | 64.68 | Accuracy (%) | 56.9 |
Interactive version: theaggregate.ai/model?slug=firefly-llama2-7b-chat-temp · How It Works · Data refreshed daily, snapshot 2026-11-08.