GritLM-7B-KTO: benchmark results

GritLM's GritLM-7B-KTO, a KTO-aligned version of GritLM-7B, a generative representational model unifying text embedding and text generation in a single checkpoint. Provider: GritLM. Released 2024-04-16. Access: Open.

Aggregate Rating 1383 ± 17, rank #1279 of 1656 rated models, from 29 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Korean LLM - KorNAT-Harmless65.37Normalized accuracy (%)79.8
Open Korean LLM - Ko-IFEval36.95Strict accuracy, prompt/instruction mean (%)77
Open Korean LLM - KorNAT-Helpful48.93Normalized accuracy (%)74.9
Open Portuguese LLM - ASSIN2 RTE92.03Macro F1 (%)73.4
Open Korean LLM - Ko-EQ-Bench22.43EQ-Bench score68
Open Portuguese LLM - FaQuAD NLI72.71Macro F1 (%)66.7
Open LLM Leaderboard - IFEval53.1Score63.1
Open Korean LLM Leaderboard36.56Average Score (%)58
Open Ko-LLM Leaderboard36.56Average (%)57.9
Open Chinese LLM - TruthfulQA MC54.48Accuracy (%)57.1
Open Korean LLM - Ko-GSM8K (flexible extract)22.21Exact match, flexible extract (%)54.6
Open LLM Leaderboard - GPQA29.78Score53.6

Interactive version: theaggregate.ai/model?slug=gritlm-7b-kto · How It Works · Data refreshed daily, snapshot 2026-10-20.