Verification Transport - PlanRewardBench (PRB) - V-AGENTIC - Macro VTFR: leaderboard

Matched native/abstracted/restored executions; 7exactmodelbackbones; protocol andbenchmark split. OBA nativebalancedaccuracy; VTFR conditionedonnativecorrectjudgments; RRR conditionedontransportfailures; RDR restoreddegradation. Denominators differ andmustnotpool. Invalid/noverdict outcomes countedunderpaperoperationalfailurepolicy. Three abstractionboundaries independent. Full immutablepayload pins alldefinitions. Metric: Native rate (%). Source: https://arxiv.org/html/2611.18471v1

Metric: Native rate (%). Source: arxiv.org. Saturation forecast: Around February 2027. 7 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1Gemini 3.7 Flash10.5#38
2Gemma 4 31B15.9#385
3Llama 4 Maverick19.5#1118
4Gemma 4 26B A4B20.7#581
5GPT-OSS-120B24.7#707
6GPT-OSS-20B26.3#1163
7Gemini 2.5 Flash36.8#467

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=verification-transport-planrewardbench-prb-v-agentic-macro-vtfr · How It Works · Data refreshed daily, snapshot 2026-11-17.