Padartha - Fine-Grained NER (Few-Shot): leaderboard
Metric: Micro-averaged F1 (%; entity mentions scored against 18 fine-grained ontology categories; 5,000-verse hand-corrected test set of the Mahabharata; two-stage few-shot pipeline: mention detection, then classification with 5 demonstrations retrieved by ByT5-Sanskrit embeddings). Source: arxiv.org. Saturation forecast: Around December 2026. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | Gemini 3 Flash | 61.91 |
| 2 | Gemma 4 12B (IT) | 34.28 |
| 3 | Qwen 2.5 7B Instruct | 12.77 |
Interactive version: theaggregate.ai/benchmark?slug=padartha-fine-grained-ner-few-shot · How It Works · Data refreshed daily, snapshot 2026-09-29.