Yandex AliceAI Cards - TriviaQA: leaderboard

TriviaQA open-domain trivia questions, 5-shot, graded by an LLM judge instead of exact match, run by Yandex. Yandex AliceAI-Foundation-80B-A3B-Base and AliceAI-T5-35B-A0.6B model cards (September 2026), joined on the runs both cards share; pretrained base checkpoints; accuracy in percent, higher is better.

Metric: Accuracy (%, LLM judge). Source: huggingface.co. Saturation forecast: Around February 2027. 10 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 3.5 35B A3B Base71.4#705
2Gemma 4 E4B65#2249
3Qwen3.5-4B-Base50.4#2450
4Qwen3.5-2B-Base32.4#6878

No result here: #4 Claude Opus 5.5, #5 GPT-6 Astra, #9 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=yandex-aliceai-cards-triviaqa · How It Works · Data refreshed daily, snapshot 2026-11-08.