CollectiveCognition-v1.1-Mistral-7B Benchmark Results

CollectiveCognition-v1.1-Mistral-7B: benchmark results

Provider: Other. Access: Open.

Unified ELO 1450 ± 19, rank #1731 of 2928 rated models, from 12 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard v1 - TruthfulQA MC2	57.62	MC2 (%) (0-shot)	70.5
Open LLM Leaderboard v1 - HellaSwag	84.17	Normalized accuracy (%) (10-shot)	64.2
Open LLM Leaderboard v1 - ARC Challenge	62.12	Normalized accuracy (%) (25-shot)	56.1
Open LLM Leaderboard v1 - MMLU	62.35	Accuracy (%) (5-shot)	55.1
Open LLM Leaderboard v1 - GSM8K	35.86	Accuracy (%) (5-shot)	51.4
Open LLM Leaderboard v1 - WinoGrande	75.37	Accuracy (%) (5-shot)	41.9
Open LLM Leaderboard - GPQA	28.69	Score	41.8
Open LLM Leaderboard - BBH	44.93	Score	33.7
Open LLM Leaderboard - MuSR	38.69	Score	33.2
Open LLM Leaderboard - MMLU-Pro	28.37	Score	31.9
Open LLM Leaderboard - IFEval	27.9	Score	25
Open LLM Leaderboard - MATH Level 5	3.1	Score	19.4