Code-Mistral-7B [bfloat16] [rev: ed3b9ad58391]: benchmark results

A Mistral fine-tune by ajibawa-2023 using QLoRA and coding, Orca math and OpenHermes datasets, with ChatML prompts. Training method, stored weight dtype and evaluated runtime quantization are separate properties. Provider: ajibawa-2023. Access: Open.

Aggregate Rating 1434 ± 34, rank #4489 of 10916 rated models, from 6 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard v1 - GSM8K68.08Accuracy (%) (5-shot)85.1
Open LLM Leaderboard v1 - WinoGrande82.24Accuracy (%) (5-shot)83
Open LLM Leaderboard v1 - MMLU65Accuracy (%) (5-shot)80
Open LLM Leaderboard v1 - HellaSwag85.29Normalized accuracy (%) (10-shot)73.4
Open LLM Leaderboard v1 - ARC Challenge64.59Normalized accuracy (%) (25-shot)67.3
Open LLM Leaderboard v1 - TruthfulQA MC254.64MC2 (%) (0-shot)63.1

Interactive version: theaggregate.ai/model?slug=code-mistral-7b-bfloat16-rev-ed3b9ad58391 · How It Works · Data refreshed daily, snapshot 2026-11-08.