Llama 3 8B Cpt Sahabatai V1 Instruct: benchmark results

GoTo/AI Singapore's Sahabat-AI Llama 3 8B Instruct, an Indonesian-focused chat model continually pretrained from Llama 3 8B and instruction-tuned on Indonesian, Javanese, Sundanese and English data. Provider: Sahabat-AI. Released 2024-11-06. Access: Open.

Aggregate Rating 1465 ± 25, rank #910 of 1656 rated models, from 18 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Sahabat-AI - Indonesian Average49.98Average Score (%)87.5
Sahabat-AI - Javanese (JV)49.64Score (%)87.5
Open LLM Leaderboard - MuSR44.88Score82.8
Sahabat-AI - Indonesian (ID)56.56Score (%)81.2
Sahabat-AI - Sundanese (SU)43.74Score (%)75
Open LLM Leaderboard - IFEval52.38Score62.4
Open LLM Leaderboard - MATH Level 512.76Score56.8
Open LLM Leaderboard - MMLU-Pro34.53Score50.1
Open LLM Leaderboard - BBH49.51Score46.3
GoTo-AI Leaderboard - Balinese38.8Score (0-100)22.2
GoTo-AI Leaderboard - Batak Toba26.85Score (0-100)22.2
Open LLM Leaderboard - GPQA26.68Score21.2

Interactive version: theaggregate.ai/model?slug=llama-3-8b-cpt-sahabatai-v1-instruct · How It Works · Data refreshed daily, snapshot 2026-10-20.