Mistral-7B-v0.1-signtensors-1-over-4 Benchmark Results

Mistral-7B-v0.1-signtensors-1-over-4: benchmark results

Provider: Mistral. Access: Open.

Aggregate Rating 1117 ± 37, rank #10548 of 10916 rated models, from 12 benchmark results.

Benchmark	Score	Metric	Percentile
Open LLM Leaderboard v1 - TruthfulQA MC2	47.95	MC2 (%) (0-shot)	39.3
Open LLM Leaderboard - GPQA	27.01	Score	24.7
Open LLM Leaderboard - MMLU-Pro	23.11	Score	23.7
Open LLM Leaderboard - BBH	35.07	Score	19.3
Open LLM Leaderboard - MATH Level 5	2.49	Score	16.3
Open LLM Leaderboard - IFEval	21.33	Score	13.8
Open LLM Leaderboard - MuSR	34.6	Score	10.9
Open LLM Leaderboard v1 - ARC Challenge	28.67	Normalized accuracy (%) (25-shot)	7.8
Open LLM Leaderboard v1 - GSM8K	0	Accuracy (%) (5-shot)	4.5
Open LLM Leaderboard v1 - WinoGrande	49.57	Accuracy (%) (5-shot)	1.7
Open LLM Leaderboard v1 - HellaSwag	25.64	Normalized accuracy (%) (10-shot)	1.4
Open LLM Leaderboard v1 - MMLU	23.12	Accuracy (%) (5-shot)	1