Atlas-Chat-9B: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1443 ± 24, rank #1033 of 1657 rated models, from 30 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
QIMMA - MizanQA59.69Normalized multiple-choice probability score (%)81.7
QIMMA - MedAraBench42.52Accuracy (%, log-likelihood multiple choice)76.8
QIMMA - 3LM STEM82.42Accuracy (%, log-likelihood multiple choice)70.7
QIMMA - MedArabiQ MCQ41.21Accuracy (%, log-likelihood multiple choice)70.7
QIMMA - PALMX71.66Accuracy (%, log-likelihood multiple choice)69.5
QIMMA - AraTrust83.33Accuracy (%, log-likelihood multiple choice)65.9
QIMMA - ArabCulture53.27Accuracy (%, log-likelihood multiple choice)65.9
QIMMA - GAT45.35Accuracy (%, log-likelihood multiple choice)63.4
QIMMA - Overall57.27Mean score across 14 benchmarks (%)63.4
DAR-MGSM - Moroccan - Localized60Accuracy (%)60
DAR-MGSM - Moroccan - Translated58.4Accuracy (%)60
QIMMA - ArabicMMLU62.07Accuracy (%, log-likelihood multiple choice)54.9

Interactive version: theaggregate.ai/model?slug=atlas-chat-9b · How It Works · Data refreshed daily, snapshot 2026-10-22.