MERA - MultiQ: leaderboard

Metric: F1 (%). Source: mera.a-ai.ru. 631 models tracked.

Top models

#ModelScore
1Gemma 4 31B (IT)67.3
2GPT-5.265.85
3Kimi K2.565.34
4GPT-5.465.22
5GLM-5.165.1
6Gemma 4 26B A4B (IT)64.59
7Mistral Large 2 (Jul)63
8Gemini 2.0 Flash62.35
9Llama 3.1 405B Instruct62.34
10Claude 3.7 Sonnet62.26
11Nova Pro 1.061.72
12Qwen 3.6 27B61.7
13Llama 3.1 Nemotron 70B Instruct61.54
14Llama 3.1 70B Instruct60.67
15DeepSeek V4 Pro60.05

Interactive version: theaggregate.ai/benchmark?slug=mera-multiq · How It Works · Data refreshed daily, snapshot 2026-09-05.