Omni-Persona - Text-to-Text: leaderboard
Text-to-Text persona matching on Omni-Persona (2026): a text query is matched to text profiles to answer personalized questions, scored by calibrated accuracy, which combines judged answers on answerable items with correct abstention on items whose persona is absent from the context. Percent; higher is better.
Metric: Calibrated accuracy (%): item-weighted accuracy over answerable items (answer judged correct by a GPT-5.4-mini judge) and absent-persona items (correct abstention by keyword matching), on the text-to-text persona matching group, zero-shot; higher is better. Source: arxiv.org. Saturation forecast: Around 2031. 10 models tracked. Updated 7 Oct 2026.
Top models
| # | Model | Setting | Score | Overall rank |
|---|---|---|---|---|
| 1 | MiniCPM-o-4.5 | Thinking | 59.7 | #1251 |
| 2 | Phi-4 Multimodal Instruct | 51.6 | #4155 | |
| 3 | Qwen3 Omni 30B A3B Instruct | 50 | #928 | |
| 4 | Gemini 3.6 Flash | High | 50 | #84 |
| 5 | Qwen2.5-Omni-3B | 48.4 | #3416 | |
| 6 | Interactive-Omni-8B | 46.8 | ||
| 7 | Gemini 3.5 Flash Lite | 42.7 | #308 | |
| 8 | gemma-4-E4B-it | 41.9 | #1577 | |
| 9 | Qwen2.5-Omni-7B | 41.9 | #1888 | |
| 10 | Gemma 4 E2B (IT) | 39.5 | #2532 |
No result here: #2 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.
Interactive version: theaggregate.ai/benchmark?slug=omni-persona-text-to-text · How It Works · Data refreshed daily, snapshot 2026-11-22.