Padartha - Coarse-Grained NER (Few-Shot): leaderboard
Metric: Micro-averaged F1 (%; entity mentions scored against five coarse tags; 5,000-verse hand-corrected test set of the Mahabharata; two-stage few-shot pipeline: mention detection, then classification with 5 demonstrations retrieved by ByT5-Sanskrit embeddings). Source: arxiv.org. Saturation forecast: Around December 2026. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Flash | 71.14 |
| 2 | Gemma 4 12B (IT) | 45.26 |
| 3 | Qwen 2.5 7B Instruct | 20.5 |
Interactive version: theaggregate.ai/benchmark?slug=padartha-coarse-grained-ner-few-shot · How It Works · Data refreshed daily, snapshot 2026-09-29.