OGCaReBench (RAG Top-5): leaderboard
Metric: Accuracy (%) with the top 5 case reports retrieved by BGE-large-en-v1.5 from the 53,617-report corpus placed in the context, on OGCaReBench (639 physician-verified free-text questions on rare, off-guideline cases from PubMed Central case reports, asking for the next clinical step after the standard options are exhausted), answers judged equivalent or mismatched to the case report's step by a GPT-5.2 judge; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 7 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | O4 Mini | 77.2 |
| 2 | Gemini 2.5 Pro | 76.7 |
| 3 | Claude Sonnet 4 (Thinking) | 76.7 |
| 4 | Claude Sonnet 4.5 | 74 |
| 5 | Llama 3.3 70B Instruct | 72.6 |
Interactive version: theaggregate.ai/benchmark?slug=ogcarebench-rag-top-5 · How It Works · Data refreshed daily, snapshot 2026-10-07.