URM-LLaMa-3.1-8B: benchmark results

Provider: LxzGordon. Released 2024-09-12. Access: Open.

Aggregate Rating 1672 ± 35, rank #468 of 10870 rated models, from 26 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench 2 Focus97.58Score (%)99.6
RewardBench Chat Hard88.16Accuracy (%)94.9
RewardBench92.94Score (%)93.2
RewardBench Reasoning96.98Accuracy (%)92.9
RewardBench 273.94Score (%)90.8
RewardBench 2 Safety91.78Score (%)89.7
RewardBench 2 Ties76.53Score (%)87.8
RewardBench Safety91.08Accuracy (%)87.5
RewardBench 2 Precise IF45Score (%)81.5
RMGAP67.33Pairwise accuracy (%; chosen response scored above a rejecte75
RMGAP - Best-of-445.28Best-of-4 accuracy (%; chosen response scored above all thre75
PMDC0.07Bradley-Terry ranking score (log-strength; ArmoRM-Llama3-8B-66.7

Interactive version: theaggregate.ai/model?slug=urm-llama-3-1-8b · How It Works · Data refreshed daily, snapshot 2026-11-12.