Tiny-Pirate-1.1B-v0.1: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1149 ± 36, rank #9976 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K1.74Accuracy (%) (5-shot)18.2
Open LLM Leaderboard v1 - WinoGrande61.4Accuracy (%) (5-shot)14.6
Open LLM Leaderboard v1 - ARC Challenge36.95Normalized accuracy (%) (25-shot)14.3
Open LLM Leaderboard v1 - HellaSwag60.17Normalized accuracy (%) (10-shot)14.3
Open LLM Leaderboard v1 - MMLU24.22Accuracy (%) (5-shot)3.3
Open LLM Leaderboard v1 - TruthfulQA MC235.84MC2 (%) (0-shot)2.8

Interactive version: theaggregate.ai/model?slug=tiny-pirate-1-1b-v0-1 · How It Works · Data refreshed daily, snapshot 2026-11-08.