CarbonBeagle-11B-truthy: benchmark results
Provider: Other. Released 2024-02-01. Access: Open.
Aggregate Rating 1444 ± 15, rank #1029 of 1656 rated models, from 46 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - TruthfulQA MC2 | 78.55 | MC2 (%) (0-shot) | 99.2 |
| Open LLM Leaderboard v1 - HellaSwag | 89.31 | Normalized accuracy (%) (10-shot) | 99.1 |
| Open Korean LLM - KorNAT-Harmless | 74.41 | Normalized accuracy (%) | 97.1 |
| Open Chinese LLM - TruthfulQA MC | 65.08 | Accuracy (%) | 96.4 |
| Open Korean LLM - KorNAT-CKA | 33.46 | Normalized accuracy (%) | 92 |
| Open LLM Leaderboard v1 - ARC Challenge | 72.27 | Normalized accuracy (%) (25-shot) | 91.4 |
| Open LLM Leaderboard v1 - WinoGrande | 83.82 | Accuracy (%) (5-shot) | 90.8 |
| Open LLM Leaderboard v1 - MMLU | 66.55 | Accuracy (%) (5-shot) | 87.5 |
| Open Korean LLM - KorNAT-Helpful | 50.2 | Normalized accuracy (%) | 84.6 |
| Open Korean LLM - Ko-GSM8K (flexible extract) | 49.66 | Exact match, flexible extract (%) | 83.5 |
| Open Medical LLM - MMLU Professional Medicine | 75 | Accuracy (%) | 81.8 |
| Open LLM Leaderboard v1 - GSM8K | 66.11 | Accuracy (%) (5-shot) | 81.2 |
Interactive version: theaggregate.ai/model?slug=carbonbeagle-11b-truthy · How It Works · Data refreshed daily, snapshot 2026-10-20.