auto: benchmark results
Provider: Other.
Aggregate Rating 1766 ± 45, rank #148 of 10800 rated models, from 9 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Arabic Broad Leaderboard - MMLU | 9.75 | Average Score (0-10) | 89.7 |
| Arabic Broad Leaderboard - Translation (incl Dialects) | 7.92 | Average Score (0-10) | 88.5 |
| Arabic Broad Leaderboard - RAG QA | 8.34 | Average Score (0-10) | 81.7 |
| Arabic Broad Leaderboard - Writing (incl Dialects) | 7.82 | Average Score (0-10) | 80.6 |
| Arabic Broad Leaderboard | 8.83 | Average Score (0-10) | 73 |
| Arabic Broad Leaderboard - Reasoning & Math | 8.47 | Average Score (0-10) | 59.5 |
| Arabic Broad Leaderboard - Trust & Safety | 8.67 | Average Score (0-10) | 54.4 |
| Arabic Broad Leaderboard - General Knowledge | 8.49 | Average Score (0-10) | 48.8 |
| Vals AI Router Index | 52.2 | Accuracy (%) | 14.8 |
Interactive version: theaggregate.ai/model?slug=auto · How It Works · Data refreshed daily, snapshot 2026-11-13.