LexKairos (Chain-of-Thought): leaderboard

LexKairos (Tsinghua University, 2026) evaluates the legal temporal capabilities of LLMs in the Chinese legal context with nine sub-tasks on statutory temporal knowledge, case chronology and statute-case time-limit reasoning, built from real judicial cases and statutes. The score is the mean of the nine sub-task scores (accuracy or F1) in percent with a generic step-by-step reasoning instruction added to the prompt of models that lack a built-in thinking mode; higher is better.

Metric: Mean score (%; average of the nine sub-task scores, accuracy or F1, over 3,800 Chinese legal temporal items from real judicial cases and statutes; chain-of-thought prompting, a generic step-by-step reasoning instruction appended to the prompt of models without a built-in thinking mode; temperature 0, 8,000 output tokens). Source: arxiv.org. Saturation forecast: Around February 2027. 2 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.1 8B31.55#4861

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=lexkairos-chain-of-thought · How It Works · Data refreshed daily, snapshot 2026-11-13.