MultiChallenge-LILT - Arabic: leaderboard
MultiChallenge-LILT - Arabic: Pass@1 accuracy (%) in LILT Aurora's localized evaluation. Multi-turn conversational instruction following; target model effort unreported.
Metric: Pass@1 accuracy (%). Source: aurora.lilt.com. Saturation forecast: Rough model projection: around 2026. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.8 Flash (Aurora Run: MultiChallenge-LILT; effort unreported) | 64.76 | |
| 2 | Claude Opus 5.5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 62.5 | |
| 3 | Claude Opus 5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 60.93 | |
| 4 | GPT-6 Sol (Aurora Run: MultiChallenge-LILT; effort unreported) | 54.57 | |
| 5 | GPT-5.6 Sol (Aurora Run: MultiChallenge-LILT; effort unreported) | 54.47 | |
| 6 | Nemotron 3 Ultra (Aurora Run: MultiChallenge-LILT; effort unreported) | 53.97 | |
| 7 | Kimi K3 (Aurora Run: MultiChallenge-LILT; effort unreported) | 50.53 | |
| 8 | Command A+ (Aurora Run: MultiChallenge-LILT; effort unreported) | 45.67 | |
| 9 | Mistral Medium 3.5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 44.64 |
Interactive version: theaggregate.ai/benchmark?slug=multichallenge-lilt-arabic · How It Works · Data refreshed daily, snapshot 2026-11-05.