MLX Benchmark V2 - MLX Optimizers: leaderboard

MLX Benchmark V2 category score for MLX optimizers.

Metric: Accuracy (%). Source: huggingface.co. Saturation forecast: Not forecast. 22 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.689.47#90
2Gemini 3 Flash (Preview)89.47#82
3Qwen 3.6 Max Preview72.73#85
4GPT-5.4 Nano68.42#328
5Gemini 2.5 Flash Lite (Preview 09-2025)68.42#318
6DeepSeek V4 Pro63.16#102
7Gemma 4 26B A4B (IT)63.16#297
8DeepSeek V4 Flash57.89#137
9Grok 4.1 Fast57.89#217
10Qwen 3.6 35B A3B42.11#226
11GPT-5 Nano26.32#425
12GLM-5.121.05#97
13Nemotron 3 Ultra15.79#235
14Kimi K2.510.53#144
15Kimi K2.65.26#104

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=mlx-benchmark-v2-mlx-optimizers · How It Works · Data refreshed daily, snapshot 2026-10-20.