BALSAM - Logic: leaderboard

BALSAM Arabic benchmark (SDAIA/KSAA, dataset version 2), Logic category: deriving conclusions in tasks on causal relations, puzzles, sequencing and prediction. The site's overall score blends LLM-judged generated answers with multiple-choice answers across the category's tasks; 0-100, higher is better.

Metric: Overall score (0-100, LLM-judged generation and multiple choice). Source: benchmarks.ksaa.gov.sa. Saturation forecast: Around 2034. 33 models tracked.

Top models

#ModelScoreOverall rank
1GLM-5 (Thinking)42.41#149 (GLM-5)
2GLM-4.7 (Reasoning)40.51#202 (GLM-4.7)
3GPT-5.240.2#115
4Kimi K2 Instruct (0905)38.31#267
5AceGPT-v2-8B-Chat38.08#746
6GPT-OSS-120B (Reasoning)37.81#346 (GPT-OSS-120B)
7Command A 03 202536.34#530
8Llama 4 Maverick Instruct36.33#467
9DeepSeek V3.235.75#210
10Qwen 3 235B A22B35.63#323
11Nova Pro (v1)35.59#508
12Fanar-C-2-27B35.18#637
13Llama 3.3 70B Instruct35.06#541
14Grok 4.1 Fast (Reasoning)34.74#227 (Grok 4.1 Fast)
15Jais-2-70B-Chat34.01#430

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=balsam-logic · How It Works · Data refreshed daily, snapshot 2026-11-05.