MLX Benchmark V2 - True/False: leaderboard

MLX Benchmark V2 true/false slice for Apple MLX framework knowledge.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 22 models tracked.

Top models

#ModelScoreOverall rank
1Kimi K2.5100#144
2DeepSeek V4 Flash100#137
3GLM-5.1100#97
4Gemini 2.5 Flash Lite (Preview 09-2025)100#318
5Claude Sonnet 4.691.67#90
6DeepSeek V4 Pro91.67#102
7Gemini 3 Flash (Preview)91.67#82
8GPT-5.4 Nano91.67#328
9Qwen 3.6 Max Preview91.67#85
10Gemma 4 26B A4B (IT)83.33#297
11Qwen 3.6 35B A3B83.33#226
12Grok 4.1 Fast83.33#217
13Nemotron 3 Ultra83.33#235
14GPT-5 Nano75#425
15Kimi K2.666.67#104

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mlx-benchmark-v2-true-false · How It Works · Data refreshed daily, snapshot 2026-10-20.