AfriEconQA - List: leaderboard

The list questions of AfriEconQA (Ajayi, Alaba and Stephen, 2026): every factor, risk or intervention a World Bank report states on a point, answered from the top five chunks of a fixed hybrid BM25 and BGE-M3 retriever over the 862-question held-out test split. Set F1 in percent over the listed items; higher is better.

Metric: Set F1 (%; the list questions (every factor, risk or intervention the evidence states) of the 862-question held-out test split, answered from the top five chunks of the fixed hybrid BM25 + BGE-M3 retriever). Source: arxiv.org. Saturation forecast: Around 2028. 3 models tracked.

Top models

#ModelScoreOverall rank
1DeepSeek V4 Pro10.1#181
2Qwen 3.6 35B A3B8.4#461
3Gemma 4 12B (IT)8.1#688

No result here: #1 Claude Fable 5.2, #2 Gemini 4 Carbon, #5 Claude Opus 5.5.

Interactive version: theaggregate.ai/benchmark?slug=afrieconqa-list · How It Works · Data refreshed daily, snapshot 2026-11-12.