ARFBench - Identification: leaderboard
Metric: Accuracy (%) on the 38 Identification questions (which of three channels are anomalous) of ARFBench, for the time series rendered as chart images (Matplotlib plots, three images for paired questions), with the series description and channel names as text; few-shot multiple-choice prompting with shuffled answer choices, temperature 0.05 (default for models without the setting), reasoning models at medium effort with 2,000 output tokens, blank or invalid answers counted wrong; higher is better. Source: arxiv.org. Saturation forecast: Around 2036. 11 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4o | 39.5 |
| 2 | GPT-5 | 31.6 |
| 3 | Claude Opus 4.6 | 31.6 |
| 4 | GPT-5.4 (Medium) | 31.6 |
| 5 | GPT-4.1 | 28.9 |
| 6 | Gemini 3 Pro | 28.9 |
| 7 | Claude Sonnet 4.5 | 18.4 |
Interactive version: theaggregate.ai/benchmark?slug=arfbench-identification · How It Works · Data refreshed daily, snapshot 2026-10-07.