Nejumi 4 - jaster (2-shot) - JCoLA (in-domain): leaderboard

Metric: Exact match (%). Source: nejumi.ai. 137 models tracked.

Top models

#ModelScore
1Llama 3.1 405B Instruct FP885
2GPT-5.1 (High)83
3Claude Opus 5 (Max)83
4Claude Opus 4.7 (xHigh)83
5Claude Opus 4.8 (xHigh)83
6Gemini 3 Pro (Preview)82
7Gemma 4 31B (IT)82
8Gemini 3 Flash (Preview)82
9GPT-5.6 Sol (Max)82
10Claude Opus 4.5 (Thinking)82
11Claude Opus 4.6 (Thinking)82
12DeepSeek V4.1 Flash82
13Qwen 3.5 397B A17B (Thinking)82
14Gemini 2.5 Pro81
15GPT-5.5 (xHigh)81

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-jaster-2-shot-jcola-in-domain · How It Works · Data refreshed daily, snapshot 2026-09-19.