Mistral Small (2409): benchmark results

Provider: Mistral. Released 2024-09-17.

Aggregate Rating 1483 ± 32, rank #2624 of 10916 rated models, from 19 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
SpeechMap Compliance92.6% Requests Completed94.7
Galileo Tool Tasks - xLAM Multiple Tool Single Call100Accuracy (%)94.4
Galileo Tool Tasks - xLAM Single Tool Multiple Call98Accuracy (%)91.7
Galileo Tool Tasks - BFCL v3 Multi-Turn Base Single Function78Accuracy (%)41.7
Galileo Tool Tasks - xLAM Single Tool Single Call93Accuracy (%)38.9
Wolfram LLM Benchmarking Project33.8Correct Functionality (%)33.8
Galileo Tool Tasks - BFCL v3 Multi-Turn Composite77Accuracy (%)33.3
Galileo Tool Tasks - Single Turn82Accuracy (%)33.3
Galileo Tool Tasks - BFCL v3 Irrelevance84Accuracy (%)30.6
Galileo Tool Tasks - tau Long Context72Accuracy (%)27.8
Galileo Tool Tasks - xLAM Multiple Tool Multiple Call85Accuracy (%)25
Galileo Tool Tasks - BFCL v3 Multi-Turn Missing Function62Accuracy (%)22.2

Interactive version: theaggregate.ai/model?slug=mistral-small-2409 · How It Works · Data refreshed daily, snapshot 2026-11-08.