GPT2-774M-CINDER-SHOW-MULTI-CHAT: benchmark results

Provider: OpenAI. Access: API.

Aggregate Rating 1124 ± 37, rank #10442 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K3.87Accuracy (%) (5-shot)22
Open LLM Leaderboard v1 - MMLU25.8Accuracy (%) (5-shot)9.9
Open LLM Leaderboard v1 - HellaSwag39.69Normalized accuracy (%) (10-shot)8
Open LLM Leaderboard v1 - WinoGrande52.17Accuracy (%) (5-shot)6.5
Open LLM Leaderboard v1 - ARC Challenge26.54Normalized accuracy (%) (25-shot)5.8
Open LLM Leaderboard v1 - TruthfulQA MC237.15MC2 (%) (0-shot)5.1

Interactive version: theaggregate.ai/model?slug=gpt2-774m-cinder-show-multi-chat · How It Works · Data refreshed daily, snapshot 2026-11-08.