vigogne-2-7B-instruct: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1307 ± 34, rank #8602 of 10916 rated models, from 22 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - TruthfulQA MC249.51MC2 (%) (0-shot)45
Open LLM Leaderboard v1 - WinoGrande75.45Accuracy (%) (5-shot)42.2
Open LLM Leaderboard v1 - HellaSwag79.97Normalized accuracy (%) (10-shot)39.6
Open LLM Leaderboard v1 - ARC Challenge56.23Normalized accuracy (%) (25-shot)35.1
CARTE - Centre-Val de Loire34.6Accuracy (%) on the 136 CARTE questions about Centre-Val de 34.6
CARTE - Pays de la Loire31.6Accuracy (%) on the 133 CARTE questions about Pays de la Loi34.6
CARTE - Bretagne43.4Accuracy (%) on the 145 CARTE questions about Bretagne, 0-sh30.8
CARTE - Provence-Alpes-Cote d'Azur36.2Accuracy (%) on the 224 CARTE questions about Provence-Alpes30.8
CARTE - Auvergne-Rhone-Alpes32.7Accuracy (%) on the 208 CARTE questions about Auvergne-Rhone28.8
CARTE38.5Accuracy (%) on all 2,431 CARTE questions (question-weighted26.9
CARTE - Bourgogne-Franche-Comte35.8Accuracy (%) on the 203 CARTE questions about Bourgogne-Fran26.9
CARTE - Corse47Accuracy (%) on the 100 CARTE questions about Corse (Corsica26.9

Interactive version: theaggregate.ai/model?slug=vigogne-2-7b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.