MultiChallenge-LILT - German: leaderboard
MultiChallenge-LILT - German: Pass@1 accuracy (%) in LILT Aurora's localized evaluation. Multi-turn conversational instruction following; target model effort unreported.
Metric: Pass@1 accuracy (%). Source: aurora.lilt.com. Saturation forecast: Rough model projection: around 2026. 9 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.8 Flash (Aurora Run: MultiChallenge-LILT; effort unreported) | 58.46 | |
| 2 | Claude Opus 5.5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 57.01 | |
| 3 | GPT-5.6 Sol (Aurora Run: MultiChallenge-LILT; effort unreported) | 55.13 | |
| 4 | GPT-6 Sol (Aurora Run: MultiChallenge-LILT; effort unreported) | 53.9 | |
| 5 | Nemotron 3 Ultra (Aurora Run: MultiChallenge-LILT; effort unreported) | 53.34 | |
| 6 | Claude Opus 5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 53.19 | |
| 7 | Kimi K3 (Aurora Run: MultiChallenge-LILT; effort unreported) | 52.73 | |
| 8 | Mistral Medium 3.5 (Aurora Run: MultiChallenge-LILT; effort unreported) | 44.85 | |
| 9 | Command A+ (Aurora Run: MultiChallenge-LILT; effort unreported) | 37.79 |
Interactive version: theaggregate.ai/benchmark?slug=multichallenge-lilt-german · How It Works · Data refreshed daily, snapshot 2026-11-05.