Gemma-SEA-LION-v4.5-E2B-IT: benchmark results

Provider: Google. Access: API.

Aggregate Rating 1560 ± 30, rank #1545 of 10916 rated models, from 130 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SEA-HELM (Tamil) - Question Answering69.02Normalized Score87.7
SEA-HELM (Filipino) - Summarization21.83Normalized Score82.5
SEA-HELM (Tamil) - Pragmatics60.35Normalized Score75.4
SEA-HELM (Burmese) - SEA-Safeguard63.05Normalized Score71.9
SEA-HELM (Filipino) - NLG54.69Normalized Score71.9
SEA-HELM (Indonesian) - Pragmatics67.89Normalized Score70.2
SEA-HELM (Tamil) - NLU81.42Normalized Score68.4
SEA-HELM (Tamil) - Translations86.11Normalized Score68.4
SEA-HELM (Thai) - Toxicity Detection41.4Normalized Score68.4
SEA-HELM (Burmese) - Global MMLU Lite47.33Normalized Score66.7
SEA-HELM (Burmese) - NLR48.04Normalized Score66.7
SEA-HELM (Burmese) - SEA-IFEval66.81Normalized Score66.7

Interactive version: theaggregate.ai/model?slug=gemma-sea-lion-v4-5-e2b-it · How It Works · Data refreshed daily, snapshot 2026-11-08.