FilBench: leaderboard

From the FilBench leaderboard (Miranda et al., 2025), which evaluates LLMs on Filipino, Tagalog and Cebuano with a lighteval fork. The FilBench score is the mean of four category scores (cultural knowledge, classical NLP, reading comprehension, generation), 0-100, higher is better. Runs missing any task are omitted, since upstream averages a missing task in as zero.

Metric: FilBench Score (%). Source: huggingface.co. Saturation forecast: Estimated already saturated. 37 models tracked.

Top models

#ModelScoreOverall rank
1GPT-4o (2024-08-06)74.27#343
2Llama 4 Maverick Instruct FP867.67#424
3Llama 4 Scout Instruct63.2#547
4Qwen 2.5 72B Instruct63.08#469
5Llama-SEA-LION-v3-70B-IT61.07#407
6Llama 3.1 70B Instruct59.66#567
7Sailor2-20B-Chat58.61#589
8Qwen 2.5 32B Instruct57.88#509
9Qwen 3 32B57.65#449
10gemma2-9B-cpt-sea-lionv3-instruct56.14#717
11Gemma 2 27B (IT)55.22#652
12Gemma 3 27B (IT)55.17#528
13Mixtral 8x22B Instruct54.28#738
14Gemma 3 12B (IT)54.04#672
15Gemma 2 9B (IT)53.33#795

No result here: #3 Claude Opus 5.5, #6 GPT-6 Astra, #7 GPT-6.1 Sol.

Interactive version: theaggregate.ai/benchmark?slug=filbench · How It Works · Data refreshed daily, snapshot 2026-11-05.