RealBirdID - Species Accuracy: leaderboard

Metric: Species-level accuracy (%) on the answerable RealBirdID images (research-grade observations of 3,442 species), zero-shot, each model asked 'What is the species of this bird?' about one wild bird photo from iNaturalist and its free-form answer mapped to the taxonomy by constrained decoding (nlg2choice), micro-averaged; higher is better. Source: arxiv.org. Saturation forecast: Around 2030. 6 models tracked.

Top models

#ModelScoreOverall rank
1Gemini 2.5 Pro12.7#145
2GPT-510.4#91
3Qwen 2.5 VL 7B Instruct6.7#643
4Llama 3.2 11B Instruct4.6#1112
5Gemma 3 12B (IT)3.1#655
6InternVL3-8B1.5#606

No result here: #3 Claude Opus 5.5, #5 GPT-6 Astra, #8 Claude Fable 5.1.

Interactive version: theaggregate.ai/benchmark?slug=realbirdid-species-accuracy · How It Works · Data refreshed daily, snapshot 2026-10-11.