WearableQA - Single-Signal: leaderboard

WearableQA (arXiv 2609.05405v1): 4,084 ten-option multiple-choice questions over wearable time series, blood biomarkers and demographics of 200 real users with up to 500 days of data. Accuracy on questions about a single wearable signal, chain-of-thought (Table 1). Higher is better.

Metric: Accuracy (%; 10-option multiple choice, chain-of-thought). Source: arxiv.org. Saturation forecast: Around February 2027. 14 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 3.1 Pro (Preview)72.4#64
2Claude Opus 4.664.9#67
3Claude Sonnet 459.8#207
4GPT-5.459.1#83
5Gemini 2.5 Pro58.1#159
6Gemma 4 26B A4B41#360
7GPT-4o32.3#357
8Llama 3.3 70B28.8#578
9Mistral Small 3.127.9#623
10Gemma 3 27B27.1#606
11Llama 3.1 8B21.2#1130
12Gemma 3 12B20.6#674
13Gemma 3 4B19.3#1088
14Llama 3.2 3B16.2#1376

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=wearableqa-single-signal · How It Works · Data refreshed daily, snapshot 2026-11-05.