VIVID (Few-shot): leaderboard

VIVID (Vietnamese Idioms for Validation and Interpretation Depth, 2026) tests culturally grounded understanding of 1,636 Vietnamese idioms and proverbs. Models explain each idiom under three-shot prompting and a GPT-4.1 judge rates the explanation from 0 to 5; higher is better.

Metric: Explanation score, 0 to 5 (out of 5); three-shot explanation of each of the 1,636 Vietnamese idioms and proverbs, rated 0-5 for semantic accuracy, completeness and native-speaker alignment by a GPT-4.1 judge with the aspect-based rubric; item-weighted mean over seven topics). Source: arxiv.org. Saturation forecast: Estimated already saturated. 8 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Flash2.6#452
2GPT-4o2.04#741
3Llama 4 Scout Base1.24#1890
4Qwen 3 14B1.12#1235
5Llama-SEA-LION-v3-8B-IT0.65#2317

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=vivid-few-shot · How It Works · Data refreshed daily, snapshot 2026-11-12.