TreeProbe (One-Shot): leaderboard
TreeProbe (UESTC and Tibet University, 2026) evaluates large language models on Tibetan-medicine multiple-choice questions organized around the native Tree of Medicine framework, over ten subtasks in three diagnostic roots. Accuracy is the unweighted macro mean over the subtasks in percent, higher is better, under one-shot prompting with English instructions and Tibetan-script content.
Metric: MCQ accuracy (%; unweighted macro mean over the ten subtasks; over TreeProbe's 3,289 expert-adjudicated Tibetan-medicine multiple-choice items in ten subtasks across three diagnostic roots, option order randomized, English prompt with Tibetan-script content; one-shot prompting with a fixed per-subtask exemplar). Source: arxiv.org. Saturation forecast: Around February 2027. 6 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.1 Flash Lite | 65.9 | #363 |
| 2 | GPT-5.4 | 65.47 | #121 |
| 3 | Qwen 3.5 397B A17B | 64.27 | #242 |
| 4 | GLM-4.7 | 57.47 | #365 |
| 5 | Claude Sonnet 4.6 | 45.22 | #158 |
| 6 | DeepSeek V3.2 (Non-reasoning) | 43.98 | #403 (DeepSeek V3.2) |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=treeprobe-one-shot · How It Works · Data refreshed daily, snapshot 2026-11-12.