NER-D - German LER - 5-Shot - Exact Macro F1: leaderboard

German13datasets; per-columnAverageexcludesSwissNERforallcolumns. SwissNER0shotonly. Exactentitystring+typematch; fuzzytoken-set-ratiothreshold.90. Microversusmacroretained. ExplicitHFcheckpoints:Ministral8BInstruct2410, Qwen3.5-9B, Gemma4-12B-it. GPT5.4mini0shotonly. Per-datasetLoRAadaptersnotattributedtobase; checkpointreleaseunresolved. Metric: F1 (0–1). Source: https://arxiv.org/html/2611.18257v1

Metric: F1 (0–1). Source: arxiv.org. Saturation forecast: Around 2028. 3 models tracked. Updated 17 Nov 2026.

Top models

#ModelScoreOverall rank
1Qwen 3.5 9B0.297#822
2Ministral-8B-Instruct-24100.246#4569
3Gemma 4 12B (IT)0.18#733

No result here: #1 Claude Fable 5.2, #2 GPT-6.2 Astra, #3 Gemini 4 Carbon.

Interactive version: theaggregate.ai/benchmark?slug=ner-d-german-ler-5-shot-exact-macro-f1 · How It Works · Data refreshed daily, snapshot 2026-11-17.