Apriel-v1.5-15B-Thinker: benchmark results

Provider: ServiceNow. Released 2025-06-01.

Aggregate Rating 1574 ± 26, rank #1343 of 10916 rated models, from 43 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
AA AIME 202587.5Accuracy (%)84.5
AA LiveCodeBench72.8Pass@1 (%)83.6
AA IFBench61.7Accuracy (%)72.9
Tau2-Bench Telecom68.42Success Rate (%)63
AA TAU-2 Bench68.42Accuracy (%)61.6
AA CritPt1.14Accuracy (%)57.1
AA MMLU-Pro77.34Accuracy (%)56.2
AA Humanity's Last Exam12.14Accuracy (%)55.3
AA GPQA Diamond71.31Accuracy (%)50.4
AA Terminal-Bench Hard10.61Accuracy (%)45.1
AA Omniscience - Software Engineering (SWE) - Go14Accuracy (%)41.1
AA Omniscience - Software Engineering (SWE) - JavaScript23.64Accuracy (%)36.9

Interactive version: theaggregate.ai/model?slug=apriel-v1-5-15b-thinker · How It Works · Data refreshed daily, snapshot 2026-11-08.