FRED-SemBench - LLM Only 48-Question Diagnostic: leaderboard
FRED-SemBench tests whether an unaided language model can interpret economic data correctly, including values, units and when clarification is needed. Deterministic strict value/unit/clarification accuracy (%).
Metric: Deterministic strict value/unit/clarification accuracy (%). Source: aclanthology.org. 1 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol (medium) | 8.33 | #22 (GPT-5.6 Sol) |
Interactive version: theaggregate.ai/benchmark?slug=fred-sembench-llm-only-48-question-diagnostic · How It Works · Data refreshed daily, snapshot 2026-10-29.