Sabiazinho-3: benchmark results

Provider: Other.

Aggregate Rating 1561 ± 48, rank #1537 of 10916 rated models, from 9 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
CAPITU - Easy94.3Strict prompt-level accuracy (%) on the 70 easy prompts (one41.2
CAPITU - Multi-Turn68Conversation accuracy (%): share of the 100 three-turn CAPIT29.4
CAPITU - Hard60Strict prompt-level accuracy (%) on the 60 hard prompts (thr23.5
CAPITU - Strict Accuracy80Strict prompt-level accuracy (%): share of prompts whose con23.5
Magis-Bench3.14AVG (self-reported)22.7
CAPITU - Instruction-Level Accuracy87.4Instruction-level accuracy (%): share of all individual cons17.6
CAPITU - Medium82.9Strict prompt-level accuracy (%) on the 70 medium prompts (t17.6
CAPITU90.2Final score (%): the mean over prompts of (2 x the share of 11.8
CAPITU - Coherence91.7Coherence score (%): a GPT-4o-mini judge's 0-1 rating of the0

Interactive version: theaggregate.ai/model?slug=sabiazinho-3 · How It Works · Data refreshed daily, snapshot 2026-11-08.