OGCaReBench (RAG Top-5): leaderboard

OGCaReBench (2026) asks free-text next-step questions on rare, off-guideline clinical cases from published case reports, verified by physicians; a GPT-5.2 judge compares each answer with the step taken in the report. On this board the top 5 case reports retrieved by BGE-large from a 53,617-report corpus are placed in the context; accuracy in percent, higher is better.

Metric: Accuracy (%) with the top 5 case reports retrieved by BGE-large-en-v1.5 from the 53,617-report corpus placed in the context, on OGCaReBench (639 physician-verified free-text questions on rare, off-guideline cases from PubMed Central case reports, asking for the next clinical step after the standard options are exhausted), answers judged equivalent or mismatched to the case report's step by a GPT-5.2 judge; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1O4 Mini77.2#368
2Gemini 2.5 Pro76.7#276
3Claude Sonnet 4Thinking76.7#410
4Claude Sonnet 4.574#261
5Llama 3.3 70B Instruct72.6#1385
6MedGemma-27B-text-it59.8#1218

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=ogcarebench-rag-top-5 · How It Works · Data refreshed daily, snapshot 2026-11-21.