LinAlg-Bench - 5x5 Matrices: leaderboard
Metric: Overall accuracy (%) on the 220 integer-entry 5x5 matrix problems (nine task types: trace, transpose, matrix-vector product, multiplication, matrix power, nullity and rank, 20 problems each, plus 50 determinants and 30 eigenvalue problems), zero-shot chain-of-thought prompt at temperature 0 with tools and code execution disabled, one run per problem, answers checked against SymPy ground truth; the table prints the share rounded to whole points; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 10 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | O1 | 87 |
| 2 | Gemini 3.1 Pro (Preview) | 86 |
| 3 | DeepSeek V3.2 | 82 |
| 4 | Qwen 3 235B A22B 2507 Instruct | 82 |
| 5 | GPT-5.2 | 75 |
| 6 | Mistral Large 3 | 67 |
| 7 | Claude Sonnet 4.5 | 62 |
| 8 | GPT-4o | 57 |
| 9 | Llama 3.3 70B Instruct | 53 |
| 10 | Qwen 2.5 72B Instruct | 49 |
Interactive version: theaggregate.ai/benchmark?slug=linalg-bench-5x5-matrices · How It Works · Data refreshed daily, snapshot 2026-10-07.