tulu-2-dpo-7B: benchmark results

Allen AI's 7B chat model, a DPO fine-tune of Llama 2 7B on public, synthetic and human-created data, part of the Tulu V2 suite. Provider: Allen AI. Released 2023-11-12. Access: Open.

Aggregate Rating 1342 ± 20, rank #1400 of 1656 rated models, from 32 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
RewardBench Chat97.49Accuracy (%)90.1
AlpacaEval77.85Length-Controlled Win Rate (%)71.9
JustEval - Depth4.36Score (1-5)60
Open Portuguese LLM - FaQuAD NLI67.68Macro F1 (%)55
AlpacaEval 1.084.22Win Rate (%)54.5
JustEval - Engagement4.69Score (1-5)46.7
JustEval - Helpfulness4.64Score (1-5)46.7
Open Portuguese LLM - ASSIN2 RTE88.27Macro F1 (%)44.2
BiGGen-Bench3.28Average Score (1-5)44.1
RewardBench Safety75.27Accuracy (%)39.8
Open Portuguese LLM - OAB Exams38.27Accuracy (%)37.9
RewardBench72.12Score (%)37.5

Interactive version: theaggregate.ai/model?slug=tulu-2-dpo-7b · How It Works · Data refreshed daily, snapshot 2026-10-20.