AGC-Bench - Problem Solving: leaderboard

The "Problem Solving" subtask of AGC-Bench. A task from AGC-Bench, evaluating models on open-ended creative and figurative-language generation — humor, metaphor, analogy, storytelling and brainstorming — typically graded by LLM-as-judge.

Metric: JRT z-score. Source: huggingface.co. Saturation forecast: Around April 2027. 83 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.51.02#144
2Claude Opus 4.70.92#49
3GPT-5.50.78#31
4Hermes 4 405B0.73#334
5GLM-4.70.72#192
6Claude Sonnet 4.50.7#142
7Claude Opus 4.50.69#83
8GLM-50.68#141
9GPT-4o0.62#343
10Claude Sonnet 4.60.61#90
11GLM-5-Turbo0.61#119
12Kimi K2.60.56#104
13Kimi K2 09050.53#288
14Mistral Large 30.51#401
15ERNIE 4.5 300B A47B0.5#458

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=agc-bench-problem-solving · How It Works · Data refreshed daily, snapshot 2026-10-20.