Mistral-7B-Base-SFT-SLiC-HF: benchmark results

Princeton NLP's Mistral-7B-Base-SFT-SLiC-HF, a Mistral 7B base model with SFT and SLiC-HF alignment, released alongside Princeton's SimPO preference-optimization paper. Provider: Princeton NLP. Released 2024-07-06. Access: Open.

Aggregate Rating 1386 ± 21, rank #1263 of 1654 rated models, from 20 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - Ko-GPQA-Diamond26.26Normalized accuracy (%)85.5
Open Korean LLM - Ko-IFEval40.27Strict accuracy, prompt/instruction mean (%)82.6
Open LLM Leaderboard - MuSR42.61Score66.6
Open Portuguese LLM - FaQuAD NLI71.82Macro F1 (%)64.4
Open Korean LLM - Ko-EQ-Bench17EQ-Bench score62.7
Open LLM Leaderboard - IFEval51.27Score61.2
Open Korean LLM Leaderboard36.42Average Score (%)56.8
Open Korean LLM - Ko-GSM8K (flexible extract)21.08Exact match, flexible extract (%)53.4
Open Portuguese LLM - ASSIN2 RTE89.26Macro F1 (%)49.2
Open LLM Leaderboard - GPQA29.19Score46.9
Open Portuguese LLM - OAB Exams40.41Accuracy (%)44
Open Portuguese LLM - BLUEX48.54Accuracy (%)42.6

Interactive version: theaggregate.ai/model?slug=mistral-7b-base-sft-slic-hf · How It Works · Data refreshed daily, snapshot 2026-10-24.