JMed48k (Text-Only) - Midwife: leaderboard

Accuracy (%) on the text-only questions of the Japanese Midwife national licensing examination, 2020-2024, in JMed48k (2026), scored against the official answers of the Ministry of Health, Labour and Welfare; higher is better.

Metric: Accuracy (%) on the text-only scored items of the Japanese Midwife national licensing examination (2020-2024) in JMed48k-Eval, official MHLW gold answers, single-shot Japanese prompts at temperature 0 with reasoning disabled where the model has a switch, JSON-constrained answers; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 21 models tracked. Updated 14 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Gemini 2.5 Pro94.3#276
2GPT-590.4#178
3Claude Sonnet 486.8#410
4GPT-5 Mini84.4#364
5Gemini 2.5 FlashNon-reasoning84.4#463
6Qwen 3.5 397B A17BNon-reasoning81.1#264
7Gemma 4 31B (IT)80.3#350
8DeepSeek R179.5#482
9Qwen 3.5 27BNon-reasoning78.7#375
10Grok 4.2078.3#301
11Llama 4 Maverick72.4#1110
12GLM-4.6V-FlashNon-reasoning68.5#1040
13Qwen 3.5 9BNon-reasoning66.5#828
14MedGemma-27B-IT61.8#1350
15Lingshu-32B59.6#1113

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=jmed48k-text-only-midwife · How It Works · Data refreshed daily, snapshot 2026-11-21.