jais-adapted-7B-chat: benchmark results
Provider: Other. Released 2024-08-02. Access: Open.
Unified ELO 1440 ± 1, rank #1100 of 1553 rated models, from 140 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open Arabic LLM - Arabic MMLU Economics (Middle School) | 79.31 | Accuracy (%) | 79.6 |
| Open Arabic LLM - Alghafa Multiple Choice Rating Sentiment Task | 53.36 | Accuracy (%) | 69.8 |
| Open Arabic LLM - Alghafa Multiple Choice Sentiment Task | 39.88 | Accuracy (%) | 66.4 |
| Open Arabic LLM - Arabic MMLU Philosophy (High School) | 61.54 | Accuracy (%) | 61.1 |
| Open Arabic LLM - Arabic MMLU HT Global Facts | 36 | Accuracy (%) | 59.9 |
| Open Arabic LLM - Aratrust Offensive | 82.61 | Accuracy (%) | 57.5 |
| Open Arabic LLM - Arabic MMLU LAW (Professional) | 66.56 | Accuracy (%) | 55.9 |
| Open Arabic LLM - Alghafa Multiple Choice Grounded Statement Xglue Mlqa Task | 81.33 | Accuracy (%) | 54 |
| Open Arabic LLM - Alghafa Multiple Choice Grounded Statement Soqal Task | 81.33 | Accuracy (%) | 50.9 |
| Open Arabic LLM - Arabic MMLU Accounting (University) | 51.35 | Accuracy (%) | 50.9 |
| Open Arabic LLM - Arabic MMLU History (Primary School) | 53.92 | Accuracy (%) | 50.9 |
| Open Arabic LLM - Arabic MMLU HT Machine Learning | 35.71 | Accuracy (%) | 50.6 |
Interactive version: theaggregate.ai/model?slug=jais-adapted-7b-chat · How It Works · Data refreshed daily, snapshot 2026-09-08.