WildFireVQA - Localization and Direction: leaderboard

WildFireVQA (2026) is an aerial wildfire-monitoring visual question answering benchmark built from paired RGB and radiometric thermal drone imagery, with multiple-choice answers generated by Gemini 2.5 Pro or, for some questions, computed from sensor data, then audited by manual verification and consistency checks. This board is accuracy in percent on the localization and direction questions with RGB images; higher is better.

Metric: Accuracy (%) on the 4 localization and direction question types of the WildFireVQA wildfire-monitoring multiple-choice questions (34 question types, 6,097 aerial frames each, from FLAME drone imagery with model-generated or sensor-derived labels, manually verified), RGB image input without retrieved thermal statistics; higher is better. Source: arxiv.org. Saturation forecast: Around February 2027. 4 models tracked. Updated 15 Nov 2026.

Top models

#ModelScoreOverall rank
1llava-v1.6-mistral-7B61.5#3999
2MiniCPM-V-259.77#7564
3Qwen 3 VL 8B Instruct40.35#1029
4InternVL2-8B38.08#3227

No result here: #1 Claude Fable 5.2, #3 Gemini 4 Neon, #4 GPT-6.2 Astra.

Interactive version: theaggregate.ai/benchmark?slug=wildfirevqa-localization-and-direction · How It Works · Data refreshed daily, snapshot 2026-11-21.