Mistral-7B-attention-100000: benchmark results

Provider: Mistral.

Aggregate Rating 1341 ± 33, rank #7950 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - WinoGrande75.61Accuracy (%) (5-shot)43.1
Open LLM Leaderboard v1 - GSM8K16.98Accuracy (%) (5-shot)38.5
Open LLM Leaderboard v1 - MMLU54.79Accuracy (%) (5-shot)34.7
Open LLM Leaderboard v1 - HellaSwag78.54Normalized accuracy (%) (10-shot)34.2
Open LLM Leaderboard v1 - TruthfulQA MC245.37MC2 (%) (0-shot)30.6
Open LLM Leaderboard v1 - ARC Challenge52.99Normalized accuracy (%) (25-shot)28.3

Interactive version: theaggregate.ai/model?slug=mistral-7b-attention-100000 · How It Works · Data refreshed daily, snapshot 2026-11-08.