Industrial-Instruction Panasonic QA: leaderboard
Metric: Set-match accuracy (%; share of the 1,000 held-out multi-select questions, generated by Qwen3-30B-A3B-Instruct from 906 public Panasonic technical documents, whose predicted option set equals the gold set, compared as unordered sets after extracting the answer from a JSON block). Source: arxiv.org. Saturation forecast: Around December 2026. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Qwen 3 4B 2507 Instruct | 28.5 |
| 2 | Phi-3 Mini 4K Instruct | 17.5 |
Interactive version: theaggregate.ai/benchmark?slug=industrial-instruction-panasonic-qa · How It Works · Data refreshed daily, snapshot 2026-09-26.