GeoScope Study - Numeric Options Only - MME-RS Count: leaderboard
GeoScope v1,MME-RS Count,981testquestions,native accuracy percent,Numeric Options Only. Seeded20%development/80%test,configuration frozen. Direct wholeimage4Mpx,firsttoken optionlogit; numeric-only response options form separate condition. GeoScope uses fixedQwen3-4Bsynthesizer,greedy,horizon5,depth5 withnamedperceptionmodel. Exact rerun protocol retained,not a framework-named checkpoint. No constant-answer test-tie upperbound or cited external scores.
Metric: Score (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | llava-onevision-qwen2-7b-ov-hf (GeoScope Study Run: method=Numeric Options Only) | 37.82 | |
| 2 | Qwen3-VL-8B-Instruct (GeoScope Study Run: method=Numeric Options Only) | 35.47 | |
| 3 | Qwen2.5-VL-7B-Instruct (GeoScope Study Run: method=Numeric Options Only) | 32.52 | |
| 4 | Qwen3-VL-4B-Instruct (GeoScope Study Run: method=Numeric Options Only) | 27.52 |
Interactive version: theaggregate.ai/benchmark?slug=geoscope-study-numeric-options-only-mme-rs-count · How It Works · Data refreshed daily, snapshot 2026-11-12.