Nejumi 4 - BFCL - Non-Live AST: leaderboard

Metric: Accuracy (%). Source: nejumi.ai. 137 models tracked.

Top models

#ModelScore
1Grok 385.93
2Claude Sonnet 4 (Non-reasoning)84.07
3Gemini 2.5 Flash82.96
4Qwen 3 30B A3B 2507 (Thinking)82.96
5Claude Opus 4 (Non-reasoning)82.59
6Claude Opus 4.7 (xHigh)82.22
7GPT-4o (2024-11-20)81.85
8Claude Sonnet 4 (Thinking)81.85
9qwen2.5-bakeneko-32B-instruct-v281.85
10Gemini 3 Pro (Preview)81.48
11Qwen 3 235B A22B 2507 (Thinking)81.48
12GPT-OSS-Swallow-20B-RL-v0.1 (Thinking)81.48
13O1 (2024-12-17) (High)81.48
14Qwen 3 Max (Preview)81.11
15Qwen 3.5 122B A10B (Thinking)81.11

Interactive version: theaggregate.ai/benchmark?slug=nejumi-4-bfcl-non-live-ast · How It Works · Data refreshed daily, snapshot 2026-09-19.