BALSAM - Entailment: leaderboard

BALSAM Arabic benchmark (SDAIA/KSAA, dataset version 2), Entailment category: deciding whether a sentence can be logically inferred from another, testing the semantic relation between text and hypothesis. The site's overall score blends LLM-judged generated answers with multiple-choice answers across the category's tasks; 0-100, higher is better.

Metric: Overall score (0-100, LLM-judged generation and multiple choice). Source: benchmarks.ksaa.gov.sa. Saturation forecast: Not forecast. 39 models tracked.

Top models

#ModelScoreOverall rank
1GPT-5.287.75#115
2Llama 4 Maverick Instruct86.92#467
3Nova Pro (v1)86.25#508
4GLM-5 (Thinking)83#149 (GLM-5)
5Yehia-7B-preview79.67#659
6GPT-OSS-120B (Reasoning)79.5#346 (GPT-OSS-120B)
7AceGPT-v2-8B-Chat78.83#746
8GLM-4.7 (Reasoning)78.42#202 (GLM-4.7)
9Llama 3.3 70B Instruct77.75#541
10Qwen 3 235B A22B77.08#323
11ALLaM-7B-Instruct-preview75.75#724
12Claude Opus 4.575.58#87
13Jais-2-70B-Chat73.17#430
14Fanar-C-2-27B71.17#637
15Command A 03 202570#530

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=balsam-entailment · How It Works · Data refreshed daily, snapshot 2026-11-05.