SciConvBench - Inconsistency Resolution - Solid Mechanics - Grounded Resolution: leaderboard
SciConvBench (2026) asks an assistant to turn an ill-posed computational-science request into a correct task specification by questioning a simulated scientist, one clarification per turn, judged against the annotated missing or conflicting requirements. This board is the conversation-grounded resolution rate on solid mechanics inconsistency resolution cases (requests with planted conflicting information), counting a case only when its issues were settled through the dialogue rather than silently assumed; percent, higher is better.
Metric: Conversation-Grounded Resolution Rate (%): share of solid mechanics inconsistency resolution cases (requests with planted conflicting information) whose issues are all resolved and grounded in the clarification dialogue rather than silently assumed, the assistant may ask one clarification question per turn of a simulated scientist (Claude Sonnet 4.6, answering only from the hidden reference specification) for at most 11 turns before producing the final task specification, guided scientist-mode system prompt, judged by Gemini 2.5 Pro against the annotated issues; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 5 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 2.5 Pro | 91.8 | #276 |
| 2 | Gemini 2.5 Flash | 78.2 | #463 |
| 3 | GPT-5.2 | 72.4 | #185 |
| 4 | Claude Sonnet 4.6 | 59.4 | #173 |
| 5 | GPT-OSS-120B | 25.3 | #704 |
No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=sciconvbench-inconsistency-resolution-solid-mechanics-grounded-resolution · How It Works · Data refreshed daily, snapshot 2026-11-21.