CLIR-Bench - Intervention Response: leaderboard

The intervention response task of CLIR-Bench (2026): accuracy in percent at characterizing how the measurements of an ICU patient change after a clinical intervention, 4-option multiple choice. Chance is 25; higher is better.

Metric: Accuracy (%) on intervention response, 4-option multiple-choice questions over serialized irregular ICU time series (Full-TS input), chance 25; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 15 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.693.33#178
2DeepSeek V4 Flash91.67#258
3Gemma 3 27B (IT)77.83#1289
4Gemma 4 12B (IT)60.33#693
5Gemini 2.5 Flash60#453
6GPT-5.4 Mini51.67#389
7Qwen 3.5 9B27.17#803
8Qwen 3.6 27B23.83#341
9Qwen 3.5 4B22.5#1175

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=clir-bench-intervention-response · How It Works · Data refreshed daily, snapshot 2026-11-13.