granite-4.0-h-3B-ar: benchmark results

Provider: IBM. Access: Open.

Aggregate Rating 1422 ± 47, rank #1133 of 1651 rated models, from 50 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
QIMMA - ArabLegalQA74.63BERTScore F1 (%)100
QIMMA - ArabCulture69.97Accuracy (%, log-likelihood multiple choice)85.4
QIMMA - MedAraBench39.82Accuracy (%, log-likelihood multiple choice)65.9
QIMMA - MedArabiQ QA52.66BERTScore F1 (%)64.8
QIMMA - 3LM STEM80.46Accuracy (%, log-likelihood multiple choice)64.6
QIMMA - AraTrust83.14Accuracy (%, log-likelihood multiple choice)64.6
QIMMA - MedArabiQ MCQ38.16Accuracy (%, log-likelihood multiple choice)61
QIMMA - Overall56.55Mean score across 14 benchmarks (%)59.8
QIMMA - GAT43.09Accuracy (%, log-likelihood multiple choice)57.3
QIMMA - MizanQA54.53Normalized multiple-choice probability score (%)53.7
QIMMA - PALMX67.38Accuracy (%, log-likelihood multiple choice)52.4
QIMMA - ArabicMMLU60.39Accuracy (%, log-likelihood multiple choice)51.2

Interactive version: theaggregate.ai/model?slug=granite-4-0-h-3b-ar · How It Works · Data refreshed daily, snapshot 2026-10-19.