STAGE-Eval: leaderboard
Metric: Exact match rate (%; share of items whose parsed JSON equals the gold object after canonicalization, a parse failure counting as a miss; the 851-item held-out STAGE-Eval test set: an LLM-written report around a real spreadsheet, an extraction prompt and a JSON Schema per item; vLLM, temperature 0.6, at most 3,100 new tokens, JSON read after any reasoning; mean of three runs, the standard deviation printed run-on in the same cell not read). Source: arxiv.org. Saturation forecast: Estimated already saturated. 12 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3 4B (Non-reasoning) | 31.37 |
| 2 | Qwen 2.5 3B Instruct | 21.5 |
| 3 | Llama 3.2 3B Instruct | 11.32 |
| 4 | Llama 3.2 1B Instruct | 4.07 |
Interactive version: theaggregate.ai/benchmark?slug=stage-eval · How It Works · Data refreshed daily, snapshot 2026-09-29.