TW-LegalBench - Civil Law: leaderboard

Civil-law questions of TW-LegalBench (2026), a Traditional Chinese benchmark built from Taiwan official legal examinations and court judgments: accuracy in percent on four-option single-answer examination questions, zero-shot with chain of thought. Higher is better.

Metric: Civil-law questions: accuracy (%) on four-option single-answer questions from Taiwan's 2020-2024 official legal examinations (civil service, judicial, police and professional), zero-shot chain-of-thought, JSON answer (format failures count as wrong), temperature 0 (1 for gpt-5 and gpt-5.2). Source: arxiv.org. Saturation forecast: Around February 2027. 13 models tracked.

Top models

#ModelScoreOverall rank
1Claude Sonnet 4.580.9#250
2GPT-577.7#167
3GPT-5.274#176
4Qwen 3 235B A22B69.1#623
5GPT-4o (2024-08-06)64.9#740
6Llama 3.1 405B57.6#1076
7GPT-OSS-120B52.7#700
8nemotron-3-nano-30B-a3B49.2#1875
9Qwen 2.5 7B46.8#2703
10GPT-OSS-20B44.4#1147

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=tw-legalbench-civil-law · How It Works · Data refreshed daily, snapshot 2026-11-13.