RRM-32B: benchmark results

Provider: Other.

Aggregate Rating 1588 ± 39, rank #1146 of 10916 rated models, from 12 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Plan-RewardBench - Multi-Turn Planning (Hard)62.1Pairwise accuracy (%) on the 73 hard multi-turn planning pai60
Plan-RewardBench - Multi-Turn Planning (Easy)68.45Pairwise accuracy (%) on the 109 easy multi-turn planning pa55
Plan-RewardBench - Safety Refusal60.3Pairwise accuracy (%) on the 51 safety-refusal pairs of the 55
IF-RewardBench - Overall Assessment (Single-Turn)0.14Kendall tau-b (-1 to 1) between the judge ranking of the res50
Plan-RewardBench - Error Recovery67.15Pairwise accuracy (%) on the 361 robust error-recovery pairs50
Plan-RewardBench - Single-Turn Planning (Hard)70.8Pairwise accuracy (%) on the 158 hard single-turn planning p50
Plan-RewardBench - Tool Irrelevance61.15Pairwise accuracy (%) on the 275 tool-irrelevance or tool-un50
Plan-RewardBench - Single-Turn Planning (Easy)75.22Pairwise accuracy (%) on the 144 easy single-turn planning p45
IF-RewardBench - Overall Assessment0.07Kendall tau-b (-1 to 1) between the judge ranking of the res37.5
Plan-RewardBench66.45Pairwise accuracy (%), macro-average of the seven scenario c35
IF-RewardBench - Overall Assessment (System-Prompt)0Kendall tau-b (-1 to 1) between the judge ranking of the res25
IF-RewardBench - Overall Assessment (Multi-Turn)0.07Kendall tau-b (-1 to 1) between the judge ranking of the res12.5

Interactive version: theaggregate.ai/model?slug=rrm-32b · How It Works · Data refreshed daily, snapshot 2026-11-08.