Translation en to Set1 spBleu — leaderboard

Metric: en→Set1 spBLEU (self-reported). Source: benchmarklist.com. 13 models tracked.

Top models

#ModelScore
1GPT-4o43.1
2Gemini 1.5 Pro43
3Claude 3.5 Sonnet42.5
4GPT-4o Mini41.1
5Nova Micro40.2
6Gemini 1.5 Flash40
7Claude 3.5 Haiku40
8Llama 3.2 90B39.7
9Gemini 1.5 Flash-8B38.2
10Llama 3.1 8B32.7

Interactive version: theaggregate.ai/benchmark?slug=translation-en-to-set1-spbleu · How the rankings work · Data refreshed daily, snapshot 2026-07-22.