Alif-1.0-8B-Instruct: benchmark results

Provider: Other.

Aggregate Rating 1354 ± 36, rank #7603 of 10916 rated models, from 7 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
UrduMMLU (English Prompt)34.55Overall exact-match accuracy (%) on UrduMMLU's Urdu multiple24.1
UrduMMLU (Urdu Prompt) - Humanities27.98Humanities (10,982 questions: ethics, fine arts, Islamic stu14.3
UrduMMLU (Urdu Prompt)28.62Overall exact-match accuracy (%) on UrduMMLU's Urdu multiple10.7
UrduMMLU (Urdu Prompt) - General Knowledge29.66General knowledge (1,362 questions, the Other domain) exact-10.7
UrduMMLU (Urdu Prompt) - Profession30.94Profession (973 questions: professional development and stud10.7
UrduMMLU (Urdu Prompt) - STEM29.04STEM (5,113 questions: biology, chemistry, computer science,10.7
UrduMMLU (Urdu Prompt) - Social Sciences28.76Social Sciences (7,959 questions in 11 subjects, including P7.1

Interactive version: theaggregate.ai/model?slug=alif-1-0-8b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.