Sailor-4B [bfloat16] [rev: bc4d4e338bf7]: benchmark results

Provider: Sea AI Lab. Access: Open.

Aggregate Rating 1237 ± 33, rank #9360 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K8.79Accuracy (%) (5-shot)29.1
Open LLM Leaderboard v1 - HellaSwag69.51Normalized accuracy (%) (10-shot)20.1
Open LLM Leaderboard v1 - ARC Challenge43.86Normalized accuracy (%) (25-shot)19.6
Open LLM Leaderboard v1 - MMLU37.45Accuracy (%) (5-shot)19.2
Open LLM Leaderboard v1 - WinoGrande65.67Accuracy (%) (5-shot)19.2
Open LLM Leaderboard v1 - TruthfulQA MC237.02MC2 (%) (0-shot)4.7

Interactive version: theaggregate.ai/model?slug=sailor-4b-bfloat16-rev-bc4d4e338bf7 · How It Works · Data refreshed daily, snapshot 2026-11-08.