HELM TORR - Wikitq: leaderboard

Metric: F1 Strings. Source: crfm.stanford.edu. 14 models tracked.

Top models

#ModelScore
1Claude 3.5 Sonnet (20241022)91.94
2DeepSeek V390.8
3GPT-4o (2024-11-20)90.75
4Llama 3.1 70B Instruct90.72
5Llama 3.1 405B Instruct90.2
6Gemini 1.5 Pro (002)88.53
7GPT-4o Mini (2024-07-18)88.42
8Gemini 1.5 Flash (002)88.07
9Qwen 2 72B Instruct86.2
10Claude 3.5 Haiku (20241022)84.98
11Llama 3.1 8B Instruct80.01
12Mistral 7B Instruct (v0.3)67.57

Interactive version: theaggregate.ai/benchmark?slug=helm-torr-wikitq · How It Works · Data refreshed daily, snapshot 2026-09-08.