MRI-Eval - Stem-Only: leaderboard
Metric: Stem-only accuracy (%): the answer options are removed and the free-text answer is marked correct or incorrect by a Grok judge (grok-4-1-fast-non-reasoning) against the keyed answer, over all 1,365 MRI-Eval items (MRI physics and GE scanner operations; GE questions carry a GE SIGNA Premier 3T context line), zero-shot at temperature 0; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Opus 4.6 | 61.1 |
| 2 | GPT-5.4 | 60.3 |
| 3 | Claude Sonnet 4.6 | 58.4 |
| 4 | Llama 3.3 70B Instruct | 37.1 |
Interactive version: theaggregate.ai/benchmark?slug=mri-eval-stem-only · How It Works · Data refreshed daily, snapshot 2026-10-07.