RealBirdID - Genus Accuracy: leaderboard

Metric: Genus-level accuracy (%) on the answerable RealBirdID images (248 genera), zero-shot, each model asked 'What is the species of this bird?' about one wild bird photo from iNaturalist and its free-form answer mapped to the taxonomy by constrained decoding (nlg2choice), micro-averaged; higher is better. Source: arxiv.org. Saturation forecast: Around December 2027. 6 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro52.8#145
2GPT-545.6#91
3Qwen 2.5 VL 7B Instruct40.6#643
4Llama 3.2 11B Instruct28.8#1112
5Gemma 3 12B (IT)24.7#655
6InternVL3-8B16.7#606

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=realbirdid-genus-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-11.