STAGE-Eval - Value Accuracy: leaderboard
Metric: Value accuracy (%; mean over items of the share of gold leaf values the prediction matches at the same JSON path; the 851-item held-out STAGE-Eval test set: an LLM-written report around a real spreadsheet, an extraction prompt and a JSON Schema per item; vLLM, temperature 0.6, at most 3,100 new tokens, JSON read after any reasoning; mean of three runs, the standard deviation printed run-on in the same cell not read). Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 2.5 3B Instruct | 45.87 |
| 2 | Qwen 3 4B (Non-reasoning) | 45.46 |
| 3 | Llama 3.2 3B Instruct | 36.05 |
| 4 | Llama 3.2 1B Instruct | 19.54 |
Interactive version: theaggregate.ai/benchmark?slug=stage-eval-value-accuracy · How It Works · Data refreshed daily, snapshot 2026-09-29.