Pixtral-12B-2409: benchmark results

Provider: Mistral. Released 2024-09-11. Access: Open.

Unified ELO 1407 ± 1, rank #1107 of 1392 rated models, from 23 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
KOFFVQA - Recognition65Score (%)45.1
KOFFVQA - Graph and Chart Understanding56Score (%)44.4
TextClass Benchmark1490.38Meta-Elo (self-reported)38.3
Clembench Multimodal v1.6.528.64clemscore (self-reported)36.8
KOFFVQA - Commonsense Reasoning65.11Score (%)30.9
KOFFVQA - Korean Recognition10Score (%)30.9
KOFFVQA - Object Attributes61.67Score (%)30.9
KOFFVQA - Table Understanding23.67Score (%)27.2
KOFFVQA44.62Overall Score (%)25.9
KOFFVQA - Relationship45.67Score (%)25.3
KOFFVQA - Korean OCR10Score (%)19.1
U-MATH - Differential Calculus16.82Accuracy (%)18.2

Interactive version: theaggregate.ai/model?slug=pixtral-12b-2409 · How It Works · Data refreshed daily, snapshot 2026-09-05.