jais-family-30B-8k-chat: benchmark results

Provider: Other. Released 2024-08-02. Access: Open.

Unified ELO 1566 ± 31, rank #763 of 2656 rated models, from 127 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Arabic LLM - Arabic MMLU HT Virology51.81Accuracy (%)91.7
Open Arabic LLM - Aratrust Offensive92.75Accuracy (%)88.2
Open Arabic LLM - Arabic MMLU Islamic Studies59.15Accuracy (%)85.8
Open Arabic LLM - Arabic MMLU HT Human Aging67.26Accuracy (%)84.9
Open Arabic LLM - Madinah QA Average63.92Accuracy (%)82.1
Open Arabic LLM - Aratrust Trustfulness76.92Accuracy (%)81.7
Open Arabic LLM - Madinah QA Arabic Language (Grammar)54.79Accuracy (%)80.6
Open Arabic LLM - Arabic MMLU History (High School)48.42Accuracy (%)79.6
Open Arabic LLM - Arabic MMLU HT World Religions70.76Accuracy (%)79
Open Arabic LLM - Arabic MMLU General Knowledge65.39Accuracy (%)78.4
Open Arabic LLM - Arabic MMLU HT Anatomy49.63Accuracy (%)78.1
Open Arabic LLM - Arabic MMLU History (Middle School)66.5Accuracy (%)76.9

Interactive version: theaggregate.ai/model?slug=jais-family-30b-8k-chat · How It Works · Data refreshed daily, snapshot 2026-09-19.