jais-adapted-70B-chat: benchmark results

Provider: Other. Released 2024-08-02. Access: Open.

Unified ELO 1508 ± 1, rank #723 of 1553 rated models, from 139 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Arabic LLM - Alghafa Multiple Choice Rating Sentiment NO Neutral Task84.35Accuracy (%)97.5
Open Arabic LLM - Arabic MMLU Economics (Middle School)82.76Accuracy (%)96.6
Open Arabic LLM - Alghafa Multiple Choice Sentiment Task43.6Accuracy (%)96
Open Arabic LLM - Arabic MMLU History (Middle School)73.89Accuracy (%)96
Open Arabic LLM - Alghafa Multiple Choice Rating Sentiment Task57.05Accuracy (%)95.1
Open Arabic LLM - Arabic MMLU HT Virology51.2Accuracy (%)88.6
Open Arabic LLM - Arabic MMLU Philosophy (High School)69.23Accuracy (%)88.6
Open Arabic LLM - Arabic MMLU Islamic Studies62.91Accuracy (%)87.7
Open Arabic LLM - Aratrust MentalHealth94.74Accuracy (%)87.3
Open Arabic LLM - Arabic MMLU Arabic Language (Middle School)77.78Accuracy (%)87
Open Arabic LLM - Arabic MMLU LAW (Professional)74.84Accuracy (%)85.8
Open Arabic LLM - Arabic MMLU General Knowledge (Primary School)73.46Accuracy (%)85.2

Interactive version: theaggregate.ai/model?slug=jais-adapted-70b-chat · How It Works · Data refreshed daily, snapshot 2026-09-08.