Inkling (Max): benchmark results

Provider: Thinking Machines. Released 2026-07-15. Access: Open.

Unified ELO 1640 ± 1, rank #204 of 2032 rated models, from 76 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Nejumi 4 - jaster (0-shot) - MMLU-ProX (Japanese)93Exact match (%)100
Nejumi 4 - jaster (2-shot) - JSQuAD82.28Character F1 (x100)99.3
Nejumi 4 - M-IFEval (Japanese)92.04Score (%)97.8
Nejumi 4 - MT-Bench (Japanese) - Roleplay99.5Judge rating (1-10, x10)96.7
Nejumi 4 - MT-Bench (Japanese) - Writing99Judge rating (1-10, x10)96.3
Nejumi 4 - jaster (0-shot) - JSICK85Exact match (%)96.3
Nejumi 4 - jaster (2-shot) - JCommonsenseQA100Exact match (%)94.5
Nejumi 4 - MT-Bench (Japanese) - Coding100Judge rating (1-10, x10)91.5
Nejumi 4 - MT-Bench (Japanese) - STEM100Judge rating (1-10, x10)90.4
Nejumi 4 - jaster (2-shot) - JSICK84Exact match (%)89.3
Nejumi 4 - MT-Bench (Japanese) - Math100Judge rating (1-10, x10)89
Nejumi 4 - Toxicity - Violation Categories51.59Criteria met (%)86.4

Interactive version: theaggregate.ai/model?slug=inkling-max · How It Works · Data refreshed daily, snapshot 2026-09-26.