SEA-HELM (Tamil) - SEA-NLI: leaderboard

Metric: Normalized Score. Source: leaderboard.sea-lion.ai. 44 models tracked.

Top models

#ModelScore
1Gemma 4 31B (IT)72.41
2Qwen 3.5 27B65.85
3Gemma 4 26B A4B (IT)64.25
4Qwen 3.5 122B A10B61.17
5Gemma 3 27B (IT)59.83
6Qwen 3.6 27B58.13
7Gemma 3 12B (IT)55.66
8Llama 4 Scout Instruct53.32
9Qwen 3.5 35B A3B47.48
10gemma-4-E4B-it45.49
11Qwen 3.6 35B A3B39.93
12Qwen 3 VL 32B Instruct38.77
13Mistral Small 437.15
14Mistral Medium 3.533.37
15Gemma 3 4B (IT)31.77

Interactive version: theaggregate.ai/benchmark?slug=sea-helm-tamil-sea-nli · How It Works · Data refreshed daily, snapshot 2026-09-19.