FilBench - Reading Comprehension: leaderboard

From the FilBench leaderboard (Miranda et al., 2025), which evaluates LLMs on Filipino, Tagalog and Cebuano with a lighteval fork. Reading Comprehension combines Belebele (Cebuano and Filipino), NewsPH NLI and Cebuano readability classification, weighted by instance count; accuracy 0-100, higher is better. Runs missing one of these tasks are omitted.

Metric: Category Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 38 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-08-06)80.12#343
2Qwen 2.5 72B Instruct75.62#469
3Llama 4 Maverick Instruct FP872.99#424
4Llama 4 Scout Instruct70.86#547
5Qwen 2.5 32B Instruct70.59#509
6Qwen 3 8B67.3#678
7Qwen 3 14B66.11#542
8Qwen 3 32B65.48#449
9Mixtral 8x22B Instruct64.78#738
10Sailor2-20B-Chat63.03#589
11SeaLLMs-v3-7B-Chat62.47#897
12Ministral-8B-Instruct-241062.33#1081
13Mixtral 8x7B Instruct60.95#1085
14Qwen 2.5 7B Instruct60.47#863
15Qwen 2.5 14B Instruct59.95#654

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=filbench-reading-comprehension · How It Works · Data refreshed daily, snapshot 2026-11-05.