MultiChallenge-LILT - English: leaderboard
MultiChallenge-LILT - English: Pass@1 accuracy (%) in LILT Aurora's localized evaluation. Multi-turn conversational instruction following; target model effort unreported.
Metric: Pass@1 accuracy (%). Source: aurora.lilt.com. Saturation forecast: Rough model projection: around 2026. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | GPT-5.6 Sol (Aurora Run: MultiChallenge-LILT; effort unreported) | 61.02 | |
| 2 | Nemotron 3 Ultra (Aurora Run: MultiChallenge-LILT; effort unreported) | 59.97 | |
| 3 | Claude Opus 5.5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 59.96 | |
| 4 | Gemini 3.8 Flash (Aurora Run: MultiChallenge-LILT; effort unreported) | 59.68 | |
| 5 | Claude Opus 5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 57.36 | |
| 6 | GPT-6 Sol (Aurora Run: MultiChallenge-LILT; effort unreported) | 55.63 | |
| 7 | Mistral Medium 3.5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 47.63 | |
| 8 | Kimi K3 (Aurora Run: MultiChallenge-LILT; effort unreported) | 46.51 | |
| 9 | Command A+ (Aurora Run: MultiChallenge-LILT; effort unreported) | 44.07 |
Interactive version: theaggregate.ai/benchmark?slug=multichallenge-lilt-english · How It Works · Data refreshed daily, snapshot 2026-11-05.