IslamicMMLU Jais-2-70B (checkpoint unspecified): benchmark results
Provider: Other.
Aggregate Rating 1601 ± 41, rank #1003 of 10916 rated models, from 11 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| IslamicMMLU - Hadith Authenticity Grading | 66.9 | Accuracy (%) on IslamicMMLU's about 1,000 Hadith track quest | 54.2 |
| IslamicMMLU - Hadith | 77.8 | Accuracy (%) on IslamicMMLU's 4,000 Hadith questions from th | 50 |
| IslamicMMLU - Hadith Source Identification | 78.8 | Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o | 45.8 |
| IslamicMMLU - Hadith Chapter Classification | 87 | Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o | 41.7 |
| IslamicMMLU - Hadith Cloze Completion | 78.7 | Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o | 37.5 |
| IslamicMMLU - Verse Retrieval | 41.8 | Accuracy (%) on IslamicMMLU's 1,066 Quran track questions on | 37.5 |
| IslamicMMLU | 63.4 | Overall accuracy (%): equally weighted mean of the Quran, Ha | 25 |
| IslamicMMLU - Quran | 48.1 | Accuracy (%) on IslamicMMLU's 2,013 Quran questions (verse r | 25 |
| IslamicMMLU - Surah Identification | 57.3 | Accuracy (%) on IslamicMMLU's 833 Quran track questions on n | 25 |
| IslamicMMLU - Fiqh | 64.4 | Accuracy (%) on IslamicMMLU's 3,200 Fiqh knowledge questions | 12.5 |
| IslamicMMLU - Verse Count | 39.5 | Accuracy (%) on IslamicMMLU's 114 Quran track questions on g | 6.2 |
Interactive version: theaggregate.ai/model?slug=islamicmmlu-jais-2-70b-checkpoint-unspecified · How It Works · Data refreshed daily, snapshot 2026-11-08.