Lexora-Lite-3B: benchmark results

DeepMount00's Italian instruction fine-tune of Qwen2.5 3B, trained with SFT and DPO on Sonnet-3.5-generated Italian data. Provider: Other. Released 2024-09-19. Access: Open.

Aggregate Rating 1458 ± 37, rank #3444 of 10916 rated models, from 13 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Pinocchio Italian - Lingua Straniera78.45Accuracy (%)93.2
Pinocchio Italian - Logica47.9Accuracy (%)88.6
Pinocchio Italian - Matematica E Scienze58.21Accuracy (%)88.6
Pinocchio Italian Leaderboard60.64Average Accuracy (%)88.6
Pinocchio Italian - Generale60.61Accuracy (%)86.4
Pinocchio Italian - Diritto56.92Accuracy (%)84.1
Open LLM Leaderboard - MATH Level 523.04Score76.4
Pinocchio Italian - Cultura61.73Accuracy (%)75
Open LLM Leaderboard - IFEval57.76Score69.8
Open LLM Leaderboard - MMLU-Pro36.02Score54.9
Open LLM Leaderboard - BBH48.73Score43.4
Open LLM Leaderboard - MuSR39.66Score39.2

Interactive version: theaggregate.ai/model?slug=lexora-lite-3b · How It Works · Data refreshed daily, snapshot 2026-11-08.