RealICU (Local Window) - Acute Problems: leaderboard

Metric: Hit@5 (0-1; share of windows whose top-5 predicted acute problems include a physician label, PubMedBERT semantic matching; local-window strategy, only the current window in the prompt). Source: arxiv.org. Saturation forecast: Around July 2027. 3 models tracked.

Top models

#ModelScore
1GPT-5.40.5
2Gemini 3.1 Pro (Preview)0.46
3Qwen 3 235B A22B0.21

Interactive version: theaggregate.ai/benchmark?slug=realicu-local-window-acute-problems · How It Works · Data refreshed daily, snapshot 2026-09-26.