CMNIE - Trigger Classification: leaderboard

Zero-shot event extraction from Chinese military news: event trigger classification, exact-match F1. Higher is better. Source: arxiv.org/abs/2609.10722.

Metric: F1 (%). Source: arxiv.org. Saturation forecast: Around September 2028. 11 models tracked.

Top models

#ModelScoreOverall rank
1Qwen 2.5 72B Instruct45.3#469
2Llama 3.1 70B Instruct43.4#567
3GPT-5.139.4#145
4Qwen 2.5 7B Instruct37.9#863
5Llama 3.3 70B Instruct36.1#541
6Qwen 2.5 14B Instruct35.3#654
7Moonshot v1 8K34.8#622
8Qwen 2.5 32B Instruct32.7#509
9GLM-4 9B Chat24.2#911
10Llama 3.1 8B Instruct23.7#1017

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=cmnie-trigger-classification · How It Works · Data refreshed daily, snapshot 2026-11-05.