calme-3.1-llamaloi-3B — benchmark results

Provider: Other. Released 2024-11-07. Access: Open.

Unified ELO 1364 ± 74, rank #1365 of 1776 rated models, from 10 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval73.75Score88.3
Open LLM Leaderboard - MATH Level 517.3Score66.1
Open LLM Leaderboard - MMLU-Pro24.5Score43.9
Open LLM Leaderboard - BBH23.77Score36
Open LLM Leaderboard - GPQA4.14Score36
French LLM Leaderboard - IFEval FR36.27Score (%)31.5
French LLM Leaderboard - BAC FR17.66Score (%)23.1
French LLM Leaderboard - Average25.85Average Score (%)22.2
French LLM Leaderboard - GPQA FR23.63Score (%)7.4
Open LLM Leaderboard - MuSR1.11Score2.6

Interactive version: theaggregate.ai/model?slug=calme-3-1-llamaloi-3b · How the rankings work · Data refreshed daily, snapshot 2026-07-22.