Omni-Persona - Text-to-Text: leaderboard

Text-to-Text persona matching on Omni-Persona (2026): a text query is matched to text profiles to answer personalized questions, scored by calibrated accuracy, which combines judged answers on answerable items with correct abstention on items whose persona is absent from the context. Percent; higher is better.

Metric: Calibrated accuracy (%): item-weighted accuracy over answerable items (answer judged correct by a GPT-5.4-mini judge) and absent-persona items (correct abstention by keyword matching), on the text-to-text persona matching group, zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 10 models tracked. Updated 7 Oct 2026.

Top models

#ModelSettingScoreOverall rank
1MiniCPM-o-4.5Thinking59.7#1251
2Phi-4 Multimodal Instruct51.6#4155
3Qwen3 Omni 30B A3B Instruct50#928
4Gemini 3.6 FlashHigh50#84
5Qwen2.5-Omni-3B48.4#3416
6Interactive-Omni-8B46.8
7Gemini 3.5 Flash Lite42.7#308
8gemma-4-E4B-it41.9#1577
9Qwen2.5-Omni-7B41.9#1888
10Gemma 4 E2B (IT)39.5#2532

No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=omni-persona-text-to-text · How It Works · Data refreshed daily, snapshot 2026-11-22.