plutus-8B-instruct — benchmark results

TheFinAI's Plutus 8B instruct model, a Greek-finance fine-tune of Llama-Krikri-8B. Provider: Other. Released 2025-02-18. Access: Open.

Unified ELO 1884 ± 106, rank #74 of 1776 rated models, from 13 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
FinBen - FinNum70.06Normalized Score100
FinBen - MultiFin72.22Normalized Score100
Open FinLLM Leaderboard55.9Average normalized score (self-reported)100
FinBen - FinText57.15Normalized Score95.8
FinBen - FNS34.46Normalized Score95
FinBen - QA64Normalized Score84.2
Greek MMLU - Greek-Specific73.96Accuracy (%)71.6
Greek MMLU - Humanities69.74Accuracy (%)71.6
Greek MMLU - Social Sciences69.73Accuracy (%)69.1
Greek MMLU65.71Accuracy (%)67.9
Greek MMLU - Other64.01Accuracy (%)67.9
Greek MMLU - STEM61.65Accuracy (%)61.7

Interactive version: theaggregate.ai/model?slug=plutus-8b-instruct · How the rankings work · Data refreshed daily, snapshot 2026-07-22.