SciIBI (Text-Only, CoT): leaderboard

Metric: Accuracy (%) of 4-way Core Instructional Practices classification (big idea, eliciting ideas, guiding sense-making, pressing for evidence) of 113 K-12 science classroom clips (82 NGSS-aligned lessons), expert consensus labels, text-only input (the ASR transcript), step-by-step reasoning before the label, temperature 0; accuracy counts parsed JSON answers; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 8 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o50.9#333
2Llama 3.3 70B Instruct [4bit]48.2#473
3Claude Sonnet 4.546.4#138
4Qwen 3 VL 235B A22B45.5#228
5Gemini 2.5 Pro42.9#145
6GPT-OSS-20B36.6#499
7Mistral 7B Instruct (v0.3)34.8#1255

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=sciibi-text-only-cot · How It Works · Data refreshed daily, snapshot 2026-10-11.