ClinSQL - Vital Signs Monitoring: leaderboard
Metric: Execution Score (%). Source: arxiv.org. Saturation forecast: Around December 2026. 22 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 2.5 Pro | 73.97 |
| 2 | GPT-5 Mini | 72.65 |
| 3 | Gemini 2.5 Flash | 63.55 |
| 4 | DeepSeek R1 0528 | 62.57 |
| 5 | GPT-4.1 | 58.07 |
| 6 | DeepSeek V3.1 | 54.83 |
| 7 | Grok 4 Fast (Reasoning) | 51.01 |
| 8 | GPT-5 Chat | 50.53 |
| 9 | O4 Mini (2025-04-16) | 46.57 |
| 10 | Qwen 3 235B A22B 2507 FP8 (Thinking) | 45.09 |
| 11 | GPT-5 Nano | 43.16 |
| 12 | Llama 4 Maverick Instruct | 42.47 |
| 13 | Qwen 3 235B A22B 2507 Instruct | 41.63 |
| 14 | Qwen 3 Next 80B A3B Instruct | 41.24 |
| 15 | Mistral Medium 3 | 41.22 |
Interactive version: theaggregate.ai/benchmark?slug=clinsql-vital-signs-monitoring · How It Works · Data refreshed daily, snapshot 2026-09-25.