tinyllama_PY-CODER-4bit-lora_4k-v12 [4bit]: benchmark results

Provider: Singapore Univ. Access: Open.

Aggregate Rating 1117 ± 38, rank #10540 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - TruthfulQA MC240.77MC2 (%) (0-shot)15.3
Open LLM Leaderboard v1 - MMLU26.49Accuracy (%) (5-shot)12.7
Open LLM Leaderboard v1 - HellaSwag41.44Normalized accuracy (%) (10-shot)8.3
Open LLM Leaderboard v1 - ARC Challenge28.16Normalized accuracy (%) (25-shot)7.4
Open LLM Leaderboard v1 - WinoGrande51.93Accuracy (%) (5-shot)6.2
Open LLM Leaderboard v1 - GSM8K0Accuracy (%) (5-shot)4.5

Interactive version: theaggregate.ai/model?slug=tinyllama-py-coder-4bit-lora-4k-v12-4bit · How It Works · Data refreshed daily, snapshot 2026-11-08.