Birbal-7B-V1 [bfloat16] [Adapter] [rev: 6623e1ec77f2]: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1408 ± 33, rank #5692 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - HellaSwag84.83Normalized accuracy (%) (10-shot)69.1
Open LLM Leaderboard v1 - WinoGrande78.77Accuracy (%) (5-shot)65.4
Open LLM Leaderboard v1 - MMLU63.59Accuracy (%) (5-shot)61.7
Open LLM Leaderboard v1 - ARC Challenge62.8Normalized accuracy (%) (25-shot)59.8
Open LLM Leaderboard v1 - GSM8K40.26Accuracy (%) (5-shot)55.5
Open LLM Leaderboard v1 - TruthfulQA MC245.34MC2 (%) (0-shot)30.5

Interactive version: theaggregate.ai/model?slug=birbal-7b-v1-bfloat16-adapter-rev-6623e1ec77f2 · How It Works · Data refreshed daily, snapshot 2026-11-08.