Open Japanese LLM v2 - M-IFEval-Ja: leaderboard
Metric: Prompt-Level Strict Accuracy (%). Source: huggingface.co. 22 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Llama 3.3 70B Instruct | 47.09 |
| 2 | llm-jp-4-8B (Thinking) | 45.35 |
| 3 | GPT-OSS-120B | 44.77 |
| 4 | llm-jp-4-32B-a3B (Thinking) | 44.77 |
| 5 | Qwen 3.6 27B (Non-reasoning) | 44.19 |
| 6 | Qwen 3 8B (Thinking) | 43.6 |
| 7 | Qwen 3.5 27B (Non-reasoning) | 41.86 |
| 8 | gemma-4-26B-A4B-it (Thinking) | 40.12 |
| 9 | Llama-3.3-Swallow-70B-Instruct-v0.4 | 37.79 |
| 10 | Qwen 3 32B (Non-reasoning) | 37.21 |
| 11 | Gemma 3 27B (IT) | 34.88 |
| 12 | GPT-OSS-20B | 33.14 |
| 13 | llm-jp-3.1-13B-instruct4 | 29.07 |
Interactive version: theaggregate.ai/benchmark?slug=open-japanese-llm-v2-m-ifeval-ja · How It Works · Data refreshed daily, snapshot 2026-09-19.