FINESSE-Bench - VLigaBench-ru: leaderboard

Metric: Accuracy (%) on the 324 VLigaBench-ru Russian-language olympiad problems in micro- and macroeconomics, financial mathematics and game theory (numerical and short answers) of FINESSE-Bench; a GPT-5.2 judge marks each answer correct or incorrect against the reference; zero-shot, one fixed prompt per task type, temperature 0 where possible, reasoning configurations with medium effort where the model offers them; higher is better. Source: arxiv.org. Saturation forecast: Around January 2027. 31 models tracked.

Top models

#ModelScore
1Qwen 3.5 397B A17B84.88
2GPT-5.2 (Medium)84.88
3Qwen 3.5 Plus (2026-02-15)84.88
4Qwen 3.5 122B A10B83.64
5Kimi K2.583.02
6GLM-4.782.41
7GLM-582.1
8Qwen 3.5 27B81.17
9Qwen 3.5 Flash (02-23)81.17
10Qwen 3.5 35B A3B80.56
11Claude Sonnet 4.6 (Medium)80.56
12Qwen 3 235B A22B 2507 (Thinking)79.32
13GPT-5.4 (Medium)79.32
14MiniMax-M2.579.01
15Claude 3.7 Sonnet (Thinking)79.01

Interactive version: theaggregate.ai/benchmark?slug=finesse-bench-vligabench-ru · How It Works · Data refreshed daily, snapshot 2026-10-07.