Fewshot-Metamath-OrcaVicuna-Mistral: benchmark results

Provider: Abacus.AI. Access: Open.

Aggregate Rating 1402 ± 34, rank #5992 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K69.14Accuracy (%) (5-shot)88.1
Open LLM Leaderboard v1 - WinoGrande78.45Accuracy (%) (5-shot)63.3
Open LLM Leaderboard v1 - TruthfulQA MC253.23MC2 (%) (0-shot)58.9
Open LLM Leaderboard v1 - MMLU61.69Accuracy (%) (5-shot)52.6
Open LLM Leaderboard v1 - HellaSwag81.82Normalized accuracy (%) (10-shot)47.2
Open LLM Leaderboard v1 - ARC Challenge59.64Normalized accuracy (%) (25-shot)44.3

Interactive version: theaggregate.ai/model?slug=fewshot-metamath-orcavicuna-mistral · How It Works · Data refreshed daily, snapshot 2026-11-08.