opus-v1-34B [float16] [rev: 4dc3e88bf59B]: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1474 ± 36, rank #2766 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - MMLU75.43Accuracy (%) (5-shot)96.8
Open LLM Leaderboard v1 - WinoGrande81.29Accuracy (%) (5-shot)78.3
Open LLM Leaderboard v1 - GSM8K61.56Accuracy (%) (5-shot)74.3
Open LLM Leaderboard v1 - HellaSwag84.9Normalized accuracy (%) (10-shot)70
Open LLM Leaderboard v1 - TruthfulQA MC255.92MC2 (%) (0-shot)66.6
Open LLM Leaderboard v1 - ARC Challenge64.33Normalized accuracy (%) (25-shot)66.2

Interactive version: theaggregate.ai/model?slug=opus-v1-34b-float16-rev-4dc3e88bf59b · How It Works · Data refreshed daily, snapshot 2026-11-08.