Gemma 4 31B (IT) (Thinking): benchmark results

Provider: Google. Released 2026-04-02. Access: Open.

Aggregate Rating 1708 ± 10, rank #335 of 2170 rated models, from 149 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FrameBench - Japanese99.1Accuracy (%; mean of five prompt templates)100
IndicBankBench - Long Context60.67Strict pass^3 (%; 89 cases passed out of the 89 cases of the100
NitiBench+ - Cited sections precision0.64Precision (0–1)100
PostEDA-Bench (ReAct) - PPA-Mono64.56Success rate (%; 35 single-objective PPA tasks, mean of 5 te100
RedHat Gemma4 FP8 - Thinking - BFCLv4 Agentic65.82Native accuracy (%)100
RedHat Gemma4 FP8 - Thinking - BFCLv4 Overall70.77Native accuracy (%)100
RedHat Gemma4 FP8 - Thinking - GPQA Diamond (0-shot, pass@1)86.36Native accuracy (%)100
Swallow - Post-trained English - Average87.4Average Score (%)100
Swallow - Post-trained English - IFBench76.5Instruction-Level Strict Accuracy (%)100
Swallow - Post-trained English - LiveCodeBench81Pass@1 (%)100
Swallow - Post-trained Japanese - WMT20 En-Ja28.5BLEU100
Werewolf Accusation Benchmark - Role Separation1.69Belief separation (wolves minus villagers, -3..+3 scale)100

Interactive version: theaggregate.ai/model?slug=gemma-4-31b-it-thinking · How It Works · Data refreshed daily, snapshot 2026-11-05.