IslamicMMLU ALLaM-7B (checkpoint unspecified) Benchmark Results

IslamicMMLU ALLaM-7B (checkpoint unspecified): benchmark results

Provider: Other.

Aggregate Rating 1581 ± 40, rank #1244 of 10916 rated models, from 11 benchmark results.

Benchmark	Score	Metric	Percentile
IslamicMMLU - Hadith Authenticity Grading	56.4	Accuracy (%) on IslamicMMLU's about 1,000 Hadith track quest	37.5
IslamicMMLU - Hadith Chapter Classification	86.3	Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o	33.3
IslamicMMLU - Hadith	70.9	Accuracy (%) on IslamicMMLU's 4,000 Hadith questions from th	29.2
IslamicMMLU - Hadith Cloze Completion	77.8	Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o	29.2
IslamicMMLU - Hadith Source Identification	63.1	Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o	29.2
IslamicMMLU - Verse Count	70.2	Accuracy (%) on IslamicMMLU's 114 Quran track questions on g	29.2
IslamicMMLU - Fiqh	64.5	Accuracy (%) on IslamicMMLU's 3,200 Fiqh knowledge questions	16.7
IslamicMMLU - Surah Identification	54.9	Accuracy (%) on IslamicMMLU's 833 Quran track questions on n	16.7
IslamicMMLU	59.5	Overall accuracy (%): equally weighted mean of the Quran, Ha	12.5
IslamicMMLU - Quran	43.2	Accuracy (%) on IslamicMMLU's 2,013 Quran questions (verse r	12.5
IslamicMMLU - Verse Retrieval	31.2	Accuracy (%) on IslamicMMLU's 1,066 Quran track questions on	4.2