Sailor-7B [float16] [rev: f8a0533c4818]: benchmark results

Provider: Sea AI Lab. Access: Open.

Aggregate Rating 1331 ± 35, rank #8140 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K32.52Accuracy (%) (5-shot)48.9
Open LLM Leaderboard v1 - MMLU54.84Accuracy (%) (5-shot)34.8
Open LLM Leaderboard v1 - HellaSwag76.21Normalized accuracy (%) (10-shot)28.2
Open LLM Leaderboard v1 - ARC Challenge49.83Normalized accuracy (%) (25-shot)24.3
Open LLM Leaderboard v1 - WinoGrande69.38Accuracy (%) (5-shot)23.4
Open LLM Leaderboard v1 - TruthfulQA MC240.12MC2 (%) (0-shot)13

Interactive version: theaggregate.ai/model?slug=sailor-7b-float16-rev-f8a0533c4818 · How It Works · Data refreshed daily, snapshot 2026-11-08.