Absurd World - Few-Shot - CAR: leaderboard
Absurd World (Albright et al., 2026) few-shot Determine Outcome task: from a text commentary of a five-shot-per-team penalty shootout under the CAR ruleset, where hitting the net earns cars instead of points, the model names the winner after three solved examples of the same ruleset, with questions drawn from the zero-shot prompts that at most the median number of models answered correctly. Accuracy over 100 prompts per model, in percent; higher is better.
Metric: Determine-Outcome Accuracy (%). Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Qwen 2.5 72B Instruct | 99 | #1093 |
| 2 | Llama 3.1 Nemotron Ultra 253B v1 | 99 | #1027 |
| 3 | Gemini 2.5 Flash | 97 | #452 |
| 4 | GPT-4.1 Mini | 97 | #775 |
| 5 | DeepSeek R1 0528 | 96 | #425 |
| 6 | Llama 3.1 405B Instruct | 93 | #1114 |
| 7 | Hermes-3-Llama-3.1-405B | 93 | #1022 |
| 8 | Gemini 2.0 Flash (001) | 91 | #724 |
| 9 | GPT-4o Mini | 89 | #1627 |
| 10 | Llama 4 Maverick Instruct | 84 | #1125 |
| 11 | Claude 3.5 Haiku | 69 | #1563 |
| 12 | Gemma 2 27B (IT) | 45 | #1815 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=absurd-world-few-shot-car · How It Works · Data refreshed daily, snapshot 2026-11-12.