BigCodeLlama-92B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1354 ± 33, rank #7611 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K44.96Accuracy (%) (5-shot)59
Open LLM Leaderboard v1 - TruthfulQA MC251.34MC2 (%) (0-shot)51.7
Open LLM Leaderboard v1 - MMLU55.4Accuracy (%) (5-shot)36.2
Open LLM Leaderboard v1 - HellaSwag77.84Normalized accuracy (%) (10-shot)32.1
Open LLM Leaderboard v1 - ARC Challenge54.78Normalized accuracy (%) (25-shot)32
Open LLM Leaderboard v1 - WinoGrande73.09Accuracy (%) (5-shot)31

Interactive version: theaggregate.ai/model?slug=bigcodellama-92b · How It Works · Data refreshed daily, snapshot 2026-11-08.