MuSP-Bench - llm-only-with-context - S&P - 72 Questions: leaderboard

Frozen released MuSP experiment: 72 questions, llm-only-with-context input, S&P subset; deterministic typed-answer scoring. Two saved historical-prompt responses remain in the published main table and are marked upstream; adjusted current-prompt results are a different population. Metadata control is labeled separately. No per-model best-format aggregation.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Around 2030. 3 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.6 Sol8.33#19
2Qwen 3.5 Omni Plus4.17#98
3Muse Spark 1.24.17#64

No result here: #4 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=musp-bench-llm-only-with-context-s-p-72-questions · How It Works · Data refreshed daily, snapshot 2026-10-22.