CLIR-Bench - Anchor-State Retrieval: leaderboard

The anchor-state retrieval task of CLIR-Bench (2026): accuracy in percent at reading the value of a clinical variable at a clinically defined anchor time in a serialized irregular ICU time series, 4-option multiple choice. Chance is 25; higher is better.

Metric: Accuracy (%) on anchor-state retrieval (value of one variable at a clinically defined anchor time), 4-option multiple-choice questions over serialized irregular ICU time series (Full-TS input), chance 25; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 15 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.4 Mini63.33#389
2Kimi K2.656.67#178
3Gemini 2.5 Flash43.33#453
4Gemma 4 12B (IT)39.5#693
5DeepSeek V4 Flash36.67#258
6Qwen 3.6 27B27.5#341
7Gemma 3 27B (IT)27.21#1289
8Qwen 3.5 4B26.83#1175
9Qwen 3.5 9B25.33#803

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=clir-bench-anchor-state-retrieval · How It Works · Data refreshed daily, snapshot 2026-11-13.