Sabiazinho-4: benchmark results

Provider: Other.

Aggregate Rating 1646 ± 31, rank #646 of 10916 rated models, from 14 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
CAPITU - Easy100Strict prompt-level accuracy (%) on the 70 easy prompts (one85.3
CAPITU - Multi-Turn87Conversation accuracy (%): share of the 100 three-turn CAPIT73.5
CAPITU - Hard73.3Strict prompt-level accuracy (%) on the 60 hard prompts (thr70.6
CAPITU94.6Final score (%): the mean over prompts of (2 x the share of 64.7
CAPITU - Instruction-Level Accuracy93.1Instruction-level accuracy (%): share of all individual cons64.7
CAPITU - Strict Accuracy87Strict prompt-level accuracy (%): share of prompts whose con64.7
MARCA (Portuguese, Basic)70.5Checklist accuracy (0-1, times 100): share of a question's c53.8
BLUEX v2 (Official)8.58Mean rubric score (0-10; 880 subquestions; evaluation errors50
MARCA (English, Basic)70.9Checklist accuracy (0-1, times 100): share of a question's c46.2
MARCA (Portuguese, Orchestrator)75.3Checklist accuracy (0-1, times 100): share of a question's c46.2
CAPITU - Medium85.7Strict prompt-level accuracy (%) on the 70 medium prompts (t44.1
Magis-Bench4.06AVG (self-reported)40.9

Interactive version: theaggregate.ai/model?slug=sabiazinho-4 · How It Works · Data refreshed daily, snapshot 2026-11-08.