HELM Classic - QuAC: leaderboard

The "QuAC" subtask of HELM Classic. A scenario from Stanford HELM Classic, the holistic evaluation suite scoring language models across accuracy, robustness and calibration on a broad set of tasks.

Metric: F1 (%). Source: crfm.stanford.edu. Saturation forecast: Estimated already saturated. 66 models tracked.

Top models

#ModelScoreOverall rank
1text-davinci-00352.48#1107
2GPT-3.5 Turbo (0613)48.5#1113
3Llama 2 70B48.44#1044
4Palmyra X (43B)47.29#1255
5text-davinci-00244.51#1200
6Llama 2 13B42.38#1414
7Mistral-7B-v0.142.32#1295
8Llama 2 7B40.62#1499
9vicuna-13B-v1.340.27#1429
10LLaMA-65B40.13#1266
11mpt-30B39.31#1454
12vicuna-7B-v1.339.22#1485
13LLaMA-30B39.02#1397
14falcon-40B Instruct37.07#1441
15davinci36.04#1533

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #6 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=helm-classic-quac · How It Works · Data refreshed daily, snapshot 2026-11-06.