Llama-3.2-Rabbit-Ko-3B-Instruct: benchmark results

CarrotAI's Korean-and-English instruction fine-tune of Meta's Llama 3.2 3B Instruct, SFT-trained on Korean instruction data. Provider: Meta. Released 2024-09-30. Access: Open.

Aggregate Rating 1405 ± 39, rank #5844 of 10916 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval71.99Score85.7
Open Korean LLM - Ko-EQ-Bench31.94EQ-Bench score81.2
Open Korean LLM - Ko-GSM8K (flexible extract)40.18Exact match, flexible extract (%)74.7
Open Korean LLM Leaderboard39.49Average Score (%)72.5
Open LLM Leaderboard - MATH Level 520.54Score71.9
Open Korean LLM - Ko-IFEval33.46Strict accuracy, prompt/instruction mean (%)67.1
Open Korean LLM - KorNAT-CKA22.4Normalized accuracy (%)39.5
Open LLM Leaderboard - BBH44.27Score32.3
Open LLM Leaderboard - MMLU-Pro28.22Score31.5
Open Korean LLM - Ko-GPQA-Diamond21.72Normalized accuracy (%)29.4
Open Korean LLM - KorNAT-Helpful44.22Normalized accuracy (%)27.9
Open LLM Leaderboard - GPQA27.1Score25.8

Interactive version: theaggregate.ai/model?slug=llama-3-2-rabbit-ko-3b-instruct · How It Works · Data refreshed daily, snapshot 2026-11-08.