LinAlg-Bench - 4x4 Matrices: leaderboard

Exact linear algebra on 220 SymPy-certified integer 4x4 matrix problems from LinAlg-Bench (2026): trace, transpose, products, matrix powers, nullity, rank, determinants and eigenvalues, solved zero-shot with shown work and no tools. Accuracy in percent; higher is better.

Metric: Overall accuracy (%) on the 220 integer-entry 4x4 matrix problems (nine task types: trace, transpose, matrix-vector product, multiplication, matrix power, nullity and rank, 20 problems each, plus 50 determinants and 30 eigenvalue problems), zero-shot chain-of-thought prompt at temperature 0 with tools and code execution disabled, one run per problem, answers checked against SymPy ground truth; higher is better. Source: arxiv.org. Saturation forecast: Estimated already saturated. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelScoreOverall rank
1O197.3#407
2Gemini 3.1 Pro (Preview)93.2#102
3GPT-5.290#190
4DeepSeek V3.288.2#425
5Qwen 3 235B A22B 2507 Instruct86.8#625
6Mistral Large 384.5#835
7Claude Sonnet 4.580.9#267
8Llama 3.3 70B Instruct73.6#1394
9GPT-4o63.6#754
10Qwen 2.5 72B Instruct62.7#1124

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=linalg-bench-4x4-matrices · How It Works · Data refreshed daily, snapshot 2026-11-22.