IslamicMMLU Fanar (checkpoint unspecified) Benchmark Results

IslamicMMLU Fanar (checkpoint unspecified): benchmark results

Provider: Other.

Aggregate Rating 1590 ± 40, rank #1124 of 10916 rated models, from 11 benchmark results.

Benchmark	Score	Metric	Percentile
IslamicMMLU - Fiqh	74.5	Accuracy (%) on IslamicMMLU's 3,200 Fiqh knowledge questions	54.2
IslamicMMLU - Surah Identification	75.3	Accuracy (%) on IslamicMMLU's 833 Quran track questions on n	45.8
IslamicMMLU - Hadith Cloze Completion	79.9	Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o	41.7
IslamicMMLU - Quran	56.9	Accuracy (%) on IslamicMMLU's 2,013 Quran questions (verse r	41.7
IslamicMMLU - Verse Count	82.5	Accuracy (%) on IslamicMMLU's 114 Quran track questions on g	41.7
IslamicMMLU	66	Overall accuracy (%): equally weighted mean of the Quran, Ha	37.5
IslamicMMLU - Hadith Source Identification	62.3	Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o	25
IslamicMMLU - Verse Retrieval	39.9	Accuracy (%) on IslamicMMLU's 1,066 Quran track questions on	25
IslamicMMLU - Hadith	66.5	Accuracy (%) on IslamicMMLU's 4,000 Hadith questions from th	20.8
IslamicMMLU - Hadith Authenticity Grading	40.1	Accuracy (%) on IslamicMMLU's about 1,000 Hadith track quest	12.5
IslamicMMLU - Hadith Chapter Classification	83.7	Accuracy (%) on IslamicMMLU's 1,000 Hadith track questions o	12.5