BAGEL-7B-MoT: benchmark results

Provider: Jon Durbin. Access: Open.

Aggregate Rating 1411 ± 36, rank #5579 of 10916 rated models, from 176 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
DLEBench61Average score (% of the maximum): mean of instruction follow88.9
XTC-Bench - Attribute Query70.4Understanding score (0-1, times 100) on attribute questions 88.9
XTC-Bench - Relation Query75.9Understanding score (0-1, times 100) on relation questions b88.9
XTC-Bench - Understanding72.4Overall understanding score (0-1, times 100) on visual quest88.9
UniEditBench (Image) - Background Consistency4.38Background consistency score (1-5): regions outside the edit87.5
XTC-Bench56.9Accuracy-weighted continuous cross-task agreement (AW-CCTA, 87.5
Unison - Internal Consistency80.3Unified score (%) on the internal consistency dimension of U85.7
XTC-Bench - Generation72.5Overall generation score (0-1, times 100): the model draws a77.8
AIM-Bench (Affective Image Manipulation) - Negative Emotion Accuracy56.61Emotion accuracy (%) on the items whose target is a negative75
TinyGrafixBench - Line Chart4.9mIoU (%)75
MedQ-Deg - Imaging Perception32.5Accuracy (%) on the Imaging Perception questions of MedQ-Deg74.4
SpatialGen-Bench (Text Answering)53.96Overall Accuracy (%)73.1

Interactive version: theaggregate.ai/model?slug=bagel-7b-mot · How It Works · Data refreshed daily, snapshot 2026-11-08.