SIT-Eval - Base Prompt - Overall: leaderboard
SIT-Eval (2026), simulated adaptive tutoring over the 100 GSM8K problems specified for the scored benchmark in section 4.3 (section 4.1 instead says 170, an unresolved source inconsistency), twelve rules aggregated into seven categories; LLM-judged rule adherence, temperature 0.8 and 1024 output tokens. Base Prompt protocol. Specialized-table Gemini row is not admitted until the source resolves its conflict with the prose LearnLM identity. Rule Adherence (0–1); higher is better.
Metric: Rule Adherence (0–1). Source: arxiv.org. Saturation forecast: Around January 2027. 5 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5 | 0.75 | #98 |
| 2 | Claude Sonnet 4.5 | 0.73 | #142 |
| 3 | Gemini 2.5 Pro | 0.65 | #152 |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=sit-eval-base-prompt-overall · How It Works · Data refreshed daily, snapshot 2026-10-20.