Smolagents - SimpleQA — leaderboard
Metric: Accuracy (%). Source: huggingface.co. 31 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | GPT-4.5 (Preview) | 88 |
| 2 | Claude 3.7 Sonnet (20250219) | 86 |
| 3 | O1 | 84 |
| 4 | Claude 3.5 Sonnet | 82 |
| 5 | O3 Mini | 80 |
| 6 | DeepSeek R1 | 74 |
Interactive version: theaggregate.ai/benchmark?slug=smolagents-simpleqa · How the rankings work · Data refreshed daily, snapshot 2026-07-22.