LongCat-Flash-Thinking: benchmark results

Provider: Meituan. Released 2025-09-21. Access: Open.

Aggregate Rating 1626 ± 26, rank #367 of 1635 rated models, from 23 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
ZeroEval MATH-50099.2MATH-500 Score100
LLM Stats (AIME 2024)93.3Score (%)95.5
LLM Stats (ZebraLogic)95.5Score (%)87.5
RecRM-Bench - Factual Consistency64.98Accuracy (%) of the factual-consistency judgement (item and 83.3
RecRM-Bench - Query-Item Relevance75.97Accuracy (%) of the three-level relevance score (irrelevant,80
RecRM-Bench - Instruction Following43.75Accuracy (%) of the overall instruction-following compliance66.7
ZeroEval GPQA Diamond81.5GPQA Diamond Score63.2
LLM Stats Score28.07LLM Stats Score (conservative rating)59.1
SuperCLUE General (September 2025) - Precise Instruction Following41.98Score50
LLM Stats (MMLU-Redux)89.3Score (%)43.4
SuperCLUE General (November 2025) - Hallucination Control77.79Score32.3
SuperCLUE General (November 2025) - Precise Instruction Following26.45Score27.4

Interactive version: theaggregate.ai/model?slug=longcat-flash-thinking · How It Works · Data refreshed daily, snapshot 2026-11-05.