Odysseys - Medium: leaderboard

Odysseys (2026) benchmarks computer-use web agents on realistic long-horizon tasks composed from the browsing journeys of real users across several websites, graded item by item against per-task rubrics. This board is the perfect-rubric rate in percent on the medium tasks; higher is better.

Metric: Perfect-rubric rate (%: share of tasks with every rubric item satisfied) on the 46 medium tasks of the Odysseys long-horizon multi-site web tasks run in an OSWorld Ubuntu desktop with Google Chrome, at most 100 steps, maximum reasoning effort, each rubric item judged from the trajectory screenshots and actions by gemini-3.1-flash-lite-preview; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 8 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1Claude Opus 4.6Max71.7#113
2GPT-5.4xHigh58.7#135
3Claude Sonnet 4.6Max50#173
4GPT-5.4 MinixHigh19.6#406
5Qwen 3.5 9B17.4#828
6Qwen 3.5 4B8.7#1241
7Qwen 3.5 35B A3B4.3#492
8uitars-1.5-7B0#7905

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=odysseys-medium · How It Works · Data refreshed daily, snapshot 2026-11-21.