llm-jp-3-13B-instruct3: benchmark results

LLM-jp 3 instruction-tuned release developed by NII's LLM-jp project, using Llama architecture and a 4,096-token context window. The named instruction-tuning generation remains distinct from the pretrained checkpoint and other instruct generations. Provider: National Institute of Informatics. Access: Open.

Aggregate Rating 1554 ± 41, rank #1655 of 10916 rated models, from 19 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
pfgen-bench - Completion Mode - Helpfulness0.47Helpfulness Score95.5
pfgen-bench - Completion Mode - Score0.73pfgen Score (mean of three)93.6
pfgen-bench - Completion Mode - Fluency0.82Fluency Score92.7
pfgen-bench - Completion Mode - Truthfulness0.91Truthfulness Score89.6
pfgen-bench - QA Mode - Fluency0.77Fluency Score83.6
pfgen-bench - QA Mode - Helpfulness0.39Helpfulness Score80.6
pfgen-bench - QA Mode - Score0.68pfgen Score (mean of three)80
pfgen-bench - Chat Mode - Fluency0.67Fluency Score79.4
pfgen-bench - QA Mode - Truthfulness0.88Truthfulness Score73
pfgen-bench - Chat Mode - Helpfulness0.28Helpfulness Score72.1
pfgen-bench - Chat Mode - Score0.59pfgen Score (mean of three)70.6
YOMI-Bench - Kanji Reading QA (Multiple Readings)89.28Accuracy (%; yes/no judgement of whether a given reading is 66.7

Interactive version: theaggregate.ai/model?slug=llm-jp-3-13b-instruct3 · How It Works · Data refreshed daily, snapshot 2026-11-08.