MedStruct-S (Two-Shot) - Semi-Structured Extraction: leaderboard

Converting OCR-derived Chinese clinical report pages into key-value pairs; MedStruct-S (Li, Wang and Qian, 2026). Micro-averaged F1 in percent on pairs whose key and value both match exactly, two-shot prompting; higher is better.

Metric: Key-value pair F1 (%; exact key and exact value, micro-averaged, OCR-derived Chinese clinical report pages, two-shot prompting). Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 32B Instruct49.24#1216
2Qwen 3 14B45.32#1235
3Qwen 3 0.6B33.47#8392

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=medstruct-s-two-shot-semi-structured-extraction · How It Works · Data refreshed daily, snapshot 2026-11-12.