Nanbeige2-16B-Chat: benchmark results

Nanbeige Lab's 16B chat model trained on 4.5T tokens and aligned with 1M-sample SFT, curriculum learning, and DPO (May 2024). Provider: Nanbeige. Released 2024-05-24.

Aggregate Rating 1453 ± 17, rank #978 of 1656 rated models, from 156 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
OpenCompass Agent - T-Eval - Chinese (CompassBench 2405)90.4Score (%)100
OpenCompass Agent - T-Eval - Chinese (CompassBench 2407)90.3Score (%)100
OpenCompass LLM - Agent - Chinese (CompassBench 2405)76.4Score (%)92.1
OpenCompass LLM - Language - Chinese (CompassBench 2407)54.4Score (%)91.2
OpenCompass Language - Creation - Chinese (CompassBench 2407)50Score (%)91.2
OpenCompass Language - Dialogue - Chinese (CompassBench 2407)58.2Score (%)91.2
OpenCompass Subjective - Knowledge - English (CompassBench 2405)52.1Score (%)90.8
OpenCompass Subjective - Knowledge (CompassBench 2405)54.7Score (%)89.5
OpenCompass Subjective - Knowledge - Chinese (CompassBench 2405)57.3Score (%)89.5
Open Chinese LLM - ARC Challenge60.32Accuracy (%)88.2
OpenCompass LLM - Agent (CompassBench 2407)85.8Score (%)88.2
Open LLM Leaderboard v1 - MMLU66.63Accuracy (%) (5-shot)87.8

Interactive version: theaggregate.ai/model?slug=nanbeige2-16b-chat · How It Works · Data refreshed daily, snapshot 2026-10-20.