NVIDIA Nemotron 49B v1 Card - MT-Bench: leaderboard

MT-Bench: two-turn open-ended conversations graded by an LLM judge on a 1 to 10 scale; the card prints only a reasoning-off score. From NVIDIA's own Llama-3.3-Nemotron-Super-49B-v1 model card, which states a 32k sequence length with benchmarks run up to 16 times and averaged, and recommends temperature 0.6 with top-p 0.95 for reasoning on and greedy decoding for reasoning off.

Metric: Score. Source: huggingface.co. 1 models tracked.

Top models

#ModelScoreOverall rank
1Llama 3.3 Nemotron Super 49B (v1) (Non-reasoning)9.17#1336 (Llama 3.3 Nemotron Super 49B (v1))

Interactive version: theaggregate.ai/benchmark?slug=nvidia-nemotron-49b-v1-card-mt-bench · How It Works · Data refreshed daily, snapshot 2026-11-12.