airoboros-7B-gpt4-fp16: benchmark results

TheBloke's Hugging Face publication of Jon Durbin's Airoboros 7B GPT4, whose original release is jondurbin/airoboros-7b-gpt4. Conversion publication is credited separately from the original model creator. Provider: TheBloke. Access: Open.

Aggregate Rating 1242 ± 16, rank #9321 of 10916 rated models, from 68 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MMLU-by-task - Global Facts40Accuracy (%)88.7
MMLU-by-task - HellaSwag60.06Accuracy (%)58.1
MMLU-by-task - International Law61.98Accuracy (%)50.5
MMLU-by-task - ARC Challenge49.83Accuracy (%)49.9
MMLU-by-task - Professional Medicine45.22Accuracy (%)48.2
MMLU-by-task - High School Physics29.8Accuracy (%)46.5
MMLU-by-task - Abstract Algebra29Accuracy (%)45.4
MMLU-by-task - Electrical Engineering40.69Accuracy (%)45.3
MMLU-by-task - Elementary Mathematics27.78Accuracy (%)45.3
MMLU-by-task - High School Geography49.49Accuracy (%)44.7
MMLU-by-task - Professional Law33.44Accuracy (%)44.7
MMLU-by-task - Logical Fallacies45.4Accuracy (%)44.4

Interactive version: theaggregate.ai/model?slug=airoboros-7b-gpt4-fp16 · How It Works · Data refreshed daily, snapshot 2026-11-08.