IyawoBench (v1.0 Protocol): leaderboard
Metric: Triage accuracy (%): share of the 200 IyawoBench v1.0 vignettes (100 refer now, 60 refer today, 40 treat here) whose first parsed triage token (REFER_NOW, REFER_TODAY or TREAT_HERE) matches the author-assigned level; a response without a token counts as wrong; one user-turn prompt citing WHO IMCI 2014, WHO malaria 2025, Surviving Sepsis 2021 and Nigerian treatment guidelines, temperature 0.1, at most 150 output tokens; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 6 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Claude Sonnet 4.5 | 67.5 |
| 2 | Llama 4 Scout Instruct | 59.5 |
| 3 | Llama 3.3 70B Instruct | 43 |
| 4 | Llama 3.1 8B Instruct | 39 |
Interactive version: theaggregate.ai/benchmark?slug=iyawobench-v1-0-protocol · How It Works · Data refreshed daily, snapshot 2026-10-07.