German LLM Index - INCLUDE v1.2 (custom-extract): leaderboard
German Language LLM Index (dach.peerbench.ai, a PeerBench project, 2026), which reruns every model itself with lm-evaluation-harness: chat template, temperature 0, up to 8,192 generated tokens, thinking models set to minimal reasoning effort where the API allows it and other models run as served. Labels carry (Reasoning off) when the site classed the run as reasoning-off (at most ten reasoning tokens, or under 0.1% of its completion tokens); other rows reasoned at the provider default or at the effort the label names. German part of INCLUDE (CohereLabs include-base-44), the audited v1.2 set of 107 valid native German exam questions, four options, scored by exact match after the lm-evaluation-harness custom-extract answer filter rather than the strict final-answer parsing of the main v1.2 board, so the two boards are kept apart. Higher is better. Source: https://dach.peerbench.ai/
Metric: Exact match, custom-extract filter (%). Source: dach.peerbench.ai. Saturation forecast: Around February 2027. 4 models tracked.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | Gemini 3.8 Flash | 93.46 | #30 |
| 2 | GLM-5.1 (Non-reasoning) | 82.24 | #109 (GLM-5.1) |
No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.
Interactive version: theaggregate.ai/benchmark?slug=german-llm-index-include-v1-2-custom-extract · How It Works · Data refreshed daily, snapshot 2026-11-05.