CLIR-Bench - Threshold Forecasting: leaderboard

The threshold forecasting task of CLIR-Bench (2026): accuracy in percent at predicting whether a clinical variable will cross a clinical threshold in a future window, 4-option multiple choice over a serialized ICU time series. Chance is 25; higher is better.

Metric: Accuracy (%) on threshold forecasting (will a variable cross a clinical threshold in a future window), 4-option multiple-choice questions over serialized irregular ICU time series (Full-TS input), chance 25; higher is better. Source: arxiv.org. Saturation forecast: Around February 2028. 15 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V4 Flash38.33#258
2Kimi K2.636.67#178
3GPT-5.4 Mini33.33#389
4Gemma 3 27B (IT)31.67#1289
5Gemma 4 12B (IT)22.17#693
6Gemini 2.5 Flash20#453
7Qwen 3.5 9B18.33#803
8Qwen 3.5 4B18.17#1175
9Qwen 3.6 27B10.5#341

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=clir-bench-threshold-forecasting · How It Works · Data refreshed daily, snapshot 2026-11-13.