Jais-2-70B-Chat: benchmark results
G42 Inception, Cerebras and MBZUAI's Jais 2 series chat model at 70B parameters, released under an Apache 2.0 license. Provider: Inception (G42), Cerebras & MBZUAI. Released 2025-12-09. Access: Open.
Aggregate Rating 1604 ± 28, rank #430 of 1635 rated models, from 43 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| QIMMA - ArabCulture | 83.24 | Accuracy (%, log-likelihood multiple choice) | 100 |
| QIMMA - ArabicMMLU | 81.29 | Accuracy (%, log-likelihood multiple choice) | 100 |
| QIMMA - AraTrust | 90.23 | Accuracy (%, log-likelihood multiple choice) | 98.8 |
| QIMMA - MizanQA | 71.78 | Normalized multiple-choice probability score (%) | 98.8 |
| QIMMA - PALMX | 83.73 | Accuracy (%, log-likelihood multiple choice) | 98.8 |
| QIMMA - AraDiCE-Culture | 78.89 | Accuracy (%, log-likelihood multiple choice) | 97 |
| QIMMA - MedAraBench | 50.89 | Accuracy (%, log-likelihood multiple choice) | 95.1 |
| QIMMA - Overall | 67.77 | Mean score across 14 benchmarks (%) | 95.1 |
| QIMMA - MedArabiQ QA | 54.67 | BERTScore F1 (%) | 93 |
| BALSAM - Factuality | 25.44 | Overall score (0-100, LLM-judged generation and multiple cho | 89.2 |
| QIMMA - 3LM STEM | 87.96 | Accuracy (%, log-likelihood multiple choice) | 89 |
| QIMMA - MedArabiQ MCQ | 50.91 | Accuracy (%, log-likelihood multiple choice) | 89 |
Interactive version: theaggregate.ai/model?slug=jais-2-70b-chat · How It Works · Data refreshed daily, snapshot 2026-11-05.