Mistral-7B-Instruct-RRHF: benchmark results

Princeton NLP's Mistral-7B-Instruct-RRHF, a Mistral 7B Instruct model aligned via RRHF, released alongside Princeton's SimPO preference-optimization paper. Provider: Princeton NLP. Released 2024-07-06. Access: Open.

Aggregate Rating 1387 ± 19, rank #1270 of 1661 rated models, from 21 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Helpful51.53Normalized accuracy (%)91
Open Korean LLM - KorNAT-Harmless67.3Normalized accuracy (%)88.8
Open Korean LLM - Ko-IFEval35.93Strict accuracy, prompt/instruction mean (%)74.4
Open Korean LLM - Ko-EQ-Bench23.67EQ-Bench score69.1
Open Portuguese LLM - FaQuAD NLI69.41Macro F1 (%)58.9
Open LLM Leaderboard - IFEval49.6Score58.2
Open Ko-LLM Leaderboard36.6Average (%)58.1
Open Korean LLM Leaderboard36.6Average Score (%)58.1
Open Portuguese LLM - ASSIN2 RTE90.28Macro F1 (%)55.8
Open Korean LLM - Ko-GSM8K (flexible extract)22.06Exact match, flexible extract (%)54.3
Open Portuguese LLM - BLUEX51.88Accuracy (%)50.8
Open Portuguese LLM - ENEM58.15Accuracy (%)43.3

Interactive version: theaggregate.ai/model?slug=mistral-7b-instruct-rrhf · How It Works · Data refreshed daily, snapshot 2026-10-23.