Abacus.AI: AI model benchmarks
AI models from Abacus.AI. Rank among companies: #92. Strongest model: Smaug-72B-v0.1 (Rating 1551, #614 overall, low coverage). Best available: Llama-3-Smaug-8B (Rating 1412, #1184 overall). Latest release: Smaug-Qwen2-72B-Instruct (Jun 26, 2024).
Models
| Rank | Model | Rating | Released | Access |
|---|---|---|---|---|
| 614 | Smaug-72B-v0.1 | 1551 ± 22 | Feb 2, 2024 | Open |
| 721 | Smaug-Llama-3-70B-Instruct | 1521 ± 34 | May 17, 2024 | Open |
| 723 | Smaug-34B-v0.1 | 1520 ± 23 | Jan 25, 2024 | Open |
| 999 | Slerp-CM-mist-dpo | 1451 ± 24 | Jan 3, 2024 | Open |
| 1101 | Liberated-Qwen1.5-14B | 1430 ± 18 | Apr 1, 2024 | Open |
| 1184 | Llama-3-Smaug-8B | 1412 ± 13 | May 1, 2024 | Open |
| 1308 | bigstral-12B-32k | 1377 ± 17 | Mar 6, 2024 | Open |
| 1458 | bigyi-15B | 1313 ± 18 | Mar 6, 2024 | Open |
Interactive version: theaggregate.ai/company?slug=abacus-ai · How It Works · Data refreshed daily, snapshot 2026-10-23.