Ornith 1.5 Release - MCP-Atlas: leaderboard
Ornith-1.5-122B official release card (2026): source-reported same-table comparisons, missing values stay absent. TerminalBench 2.1 uses Claude Code 2.1.126, temperature/top-p 1 and 131072 output tokens, five runs. SWE variants use OpenHands, temperature 1/top-p 0.95, 256K context and anti-hacking safeguards. NL2Repo uses 400K context and 48K output; HLE uses Claude Opus 4.6 judge; MCP-Atlas uses thinking mode, public 500-task subset and 10-minute limit. Toolathlon uses official Verified service at 128K; ClawEval temperature 0.6 and 256K context. No comparison is fused with a differently configured source
Metric: Score (%). Source: huggingface.co. Saturation forecast: Rough model projection: around 2026. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Ornith-1.5-122B (Thinking) | 74.6 | |
| 2 | DeepSeek-V4-Flash-0731 (Thinking) | 74.6 | |
| 3 | Qwen3.8-Flash-Next (Thinking) | 74.1 | #72 (Qwen3.8-Flash-Next) |
| 4 | Qwen3.8-27B (Thinking) | 69 | |
| 5 | Nemotron 3.5 Super VL (Thinking) | 63.3 | #167 (Nemotron 3.5 Super VL) |
Interactive version: theaggregate.ai/benchmark?slug=ornith-1-5-release-mcp-atlas · How It Works · Data refreshed daily, snapshot 2026-10-21.