Giraffe-13B-32k-v3: benchmark results

Provider: Abacus.AI. Access: Open.

Aggregate Rating 1359 ± 33, rank #7476 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - WinoGrande76.95Accuracy (%) (5-shot)52
Open LLM Leaderboard v1 - GSM8K26.16Accuracy (%) (5-shot)44.4
Open LLM Leaderboard v1 - ARC Challenge59.04Normalized accuracy (%) (25-shot)41.9
Open LLM Leaderboard v1 - HellaSwag79.59Normalized accuracy (%) (10-shot)38.4
Open LLM Leaderboard v1 - MMLU55.01Accuracy (%) (5-shot)35.2
Open LLM Leaderboard v1 - TruthfulQA MC246.68MC2 (%) (0-shot)35.2

Interactive version: theaggregate.ai/model?slug=giraffe-13b-32k-v3 · How It Works · Data refreshed daily, snapshot 2026-11-08.