bagel-7B-v0.5: benchmark results

Provider: Jon Durbin. Access: Open.

Aggregate Rating 1424 ± 33, rank #4990 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU64.93Accuracy (%) (5-shot)78.8
Open LLM Leaderboard v1 - WinoGrande80.98Accuracy (%) (5-shot)76.5
Open LLM Leaderboard v1 - TruthfulQA MC255.76MC2 (%) (0-shot)66
Open LLM Leaderboard v1 - ARC Challenge63.65Normalized accuracy (%) (25-shot)63.7
Open LLM Leaderboard v1 - GSM8K50.34Accuracy (%) (5-shot)62.8
Open LLM Leaderboard v1 - HellaSwag83.62Normalized accuracy (%) (10-shot)60.1

Interactive version: theaggregate.ai/model?slug=bagel-7b-v0-5 · How It Works · Data refreshed daily, snapshot 2026-11-08.