TW-LegalBench - Criminal Law: leaderboard

Criminal-law questions of TW-LegalBench (2026), a Traditional Chinese benchmark built from Taiwan official legal examinations and court judgments: accuracy in percent on four-option single-answer examination questions, zero-shot with chain of thought. Higher is better.

Metric: Criminal-law questions: accuracy (%) on four-option single-answer questions from Taiwan's 2020-2024 official legal examinations (civil service, judicial, police and professional), zero-shot chain-of-thought, JSON answer (format failures count as wrong), temperature 0 (1 for gpt-5 and gpt-5.2). Source: arxiv.org. Saturation forecast: Around February 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.582.6#250
2GPT-578.7#167
3GPT-5.276.2#176
4Qwen 3 235B A22B75.3#623
5GPT-4o (2024-08-06)68.6#740
6Llama 3.1 405B63.9#1076
7GPT-OSS-120B58.5#700
8nemotron-3-nano-30B-a3B57.2#1875
9Qwen 2.5 7B52.1#2703
10GPT-OSS-20B51.9#1147

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=tw-legalbench-criminal-law · How It Works · Data refreshed daily, snapshot 2026-11-13.