Magpie: AI model benchmarks

AI models from Magpie. Rank among companies: #199. Strongest model: Llama 3 8B Magpie Align V0.3 (Rating 1419, #1131 overall, low coverage). Latest release: MagpieLM-8B-Chat-v0.1 (Sep 15, 2024).

Models

RankModelRatingReleasedAccess
1131Llama 3 8B Magpie Align V0.31419 ± 17Jul 15, 2024Open
1141Llama 3 8B Magpie Align SFT V0.31417 ± 17Jul 13, 2024Open
1192MagpieLM-8B-Chat-v0.11404 ± 22Sep 15, 2024Open
1224MagpieLM-8B-SFT-v0.11392 ± 21Sep 15, 2024Open
1225Llama 3.1 8B Magpie Align SFT V0.11392 ± 21Jul 23, 2024Open

Interactive version: theaggregate.ai/company?slug=magpie · How It Works · Data refreshed daily, snapshot 2026-11-05.