AfriEconQA - Synthesis: leaderboard
Metric: Token F1 (%; the synthesis questions (connected policy claims or economic mechanisms) of the 862-question held-out test split, answered from the top five chunks of the fixed hybrid BM25 + BGE-M3 retriever). Source: arxiv.org. Saturation forecast: Around October 2027. 3 models tracked.
Top models
| # | Model | Score |
|---|---|---|
| 1 | DeepSeek V4 Pro | 43.3 |
| 2 | Qwen 3.6 35B A3B | 41.6 |
| 3 | Gemma 4 12B (IT) | 39.9 |
Interactive version: theaggregate.ai/benchmark?slug=afrieconqa-synthesis · How It Works · Data refreshed daily, snapshot 2026-09-26.