Polish Legal RAG - Legal Reasoning: leaderboard

Polish Legal RAG leaderboard by gaius-lex, sum_rag_v2 task: advanced Polish legal reasoning over provided sources, covering contradiction resolution and whether hypothetical situations meet legal criteria. Score 0-100, higher is better; 16 models, results frozen since August 2025.

Metric: Score (0-100). Source: huggingface.co. Saturation forecast: Around February 2027. 16 models tracked.

Top models

#ModelScoreOverall rank
1GLM 4.5 Air87.72#403
2GLM-4.585.68#283
3Qwen 3 30B A3B84.19#496
4Qwen 3 14B83.09#542
5Qwen 3 32B78.99#449
6GPT-OSS-120B77.37#346
7Kimi K276.48#252
8Qwen 3 235B A22B 2507 Instruct75.02#315
9Qwen 3 235B A22B 2507 (Thinking)73.67#263
10PLLuM-12B-nc-chat65.23#1109
11GPT-OSS-20B54.49#523
12Llama 3 8B Instruct53.03#1116

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=polish-legal-rag-legal-reasoning · How It Works · Data refreshed daily, snapshot 2026-11-05.