SDS Field Extraction (Multimodal Pipeline): leaderboard
SDS Field Extraction (2026) scores LLMs on extracting 235 schema fields, including tables and hazard pictograms, from ten industrial chemical Safety Data Sheets against manually validated ground truth. The board is field-level accuracy in percent, averaged over zero-shot, few-shot and chain-of-thought prompts, with the PDF given directly to a vision-capable model; higher is better.
Metric: Mean field-level accuracy (%) of structured extraction from ten industrial Safety Data Sheets (235 schema fields across ten sections, about 50,000 labeled fields) against manually validated ground truth, averaged over zero-shot, few-shot and chain-of-thought prompts, with the PDF passed directly to the vision-capable model; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 3 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Claude 3.7 Sonnet | 77 | #458 |
| 2 | GPT-4o | 76 | #741 |
| 3 | Gemini 1.5 Pro | 73 | #1049 |
No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.
Interactive version: theaggregate.ai/benchmark?slug=sds-field-extraction-multimodal-pipeline · How It Works · Data refreshed daily, snapshot 2026-11-13.