TKFQA (Table-Text-KG Order): leaderboard

TKFQA (2026) asks counterfactual multi-hop questions whose evidence is spread over a table, text passages and a knowledge graph, so the answer must follow the given context rather than memory. Exact match of the final answer in percent, higher is better, with the contexts given in table, text, knowledge-graph order.

Metric: Exact match (%; final answers to counterfactual multi-hop questions grounded in a table, text passages and a knowledge graph, 1,012 test items; contexts given in table, text, knowledge-graph order; mean of three runs). Source: arxiv.org. Saturation forecast: Estimated already saturated. 14 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V4 Flash84.66#254
2O384.5#224
3Gemini 2.5 Flash84.2#452
4DeepSeek V3.283.05#403
5O4 Mini82.5#354
6Kimi K2.579.31#252
7Grok 4.379.22#332
8GPT-575.38#163
9MiniMax-M2.772.42#519
10GPT-4.1 Mini71.44#775
11Gemini 2.5 Flash Lite69.93#958
12Qwen 3 30B A3B64.9#1124
13Gemma 3 12B62.33#2013
14Qwen 3 8B52.35#1838

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=tkfqa-table-text-kg-order · How It Works · Data refreshed daily, snapshot 2026-11-12.