SO-Arena v1.0 - Tool & API Use: leaderboard
SO-Arena v1.0 Tool & API Use domain score on the source-selected1232-task panel. Domain scores average native task credits for static decisions, tool outcomes or web progress, then scale to0–100. The full release has2919tasks; this leaderboard emphasizes the highest difficulty tiers and keeps all untiered sentiment/knowledge tasks. Metric: Native panel task credit mean (%). Higher is better.
Metric: Native panel task credit mean (%). Source: huggingface.co. Saturation forecast: Around February 2027. 20 models tracked. Updated 14 Nov 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | GPT-6 Luna | Medium | 68.27 | #99 |
| 2 | PPLX-Decider-v1.2 | 67.31 | ||
| 3 | GPT-6 Sol | Medium | 66.35 | #26 |
| 4 | GLiDE v1.2 | 65.38 | ||
| 5 | Kev 27B | 61.54 | ||
| 6 | Sieve-31B-v3 | 59.62 | ||
| 7 | Jev 1.14.0 | 58.65 | ||
| 8 | JevAny-27B | 57.69 | ||
| 9 | KnowLine-31B-Gen1 | 55.77 | ||
| 10 | Clef 27B | 54.81 | ||
| 11 | StartLux-v1.1-4B-Instant | 53.85 | ||
| 12 | StartLux-v1.1-4B-AutoThink | 46.15 | ||
| 13 | PPLX-Decider-Flash-v1.2 | 41.35 | ||
| 14 | JevAny-4B | 41.35 | ||
| 15 | H2O-Lightning-4B | 37.5 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=so-arena-v1-0-tool-api-use · How It Works · Data refreshed daily, snapshot 2026-11-16.