BeagleCatMunin: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1428 ± 42, rank #4784 of 10916 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Swedish NLU - Swerec77.37Matthews correlation coefficient (%)75.1
EuroEval Portuguese NLU - SST-2 PT79.94Matthews correlation coefficient (%)65.8
EuroEval Portuguese NLU - MultiWikiQA PT71.74Character F1 (%)65.7
EuroEval Swedish Common Sense Reasoning36.65Common Sense Reasoning Average Score (%)52.2
EuroEval Portuguese NLU - HAREM41.23Micro F1 excluding MISC (%)49.1
EuroEval Swedish NLU - ScaLA SV27.84Matthews correlation coefficient (%)47
EuroEval Swedish45.44Average Score (%)45.4
EuroEval Swedish Knowledge34.8Knowledge Average Score (%)45.4
EuroEval Portuguese NLU48.23NLU Average Score (%)45.3
EuroEval Portuguese40.79Average Score (%)44.9
EuroEval Swedish NLU51.91NLU Average Score (%)44.7
EuroEval Swedish NLU - SUC350.53Micro F1 excluding MISC (%)39.3

Interactive version: theaggregate.ai/model?slug=beaglecatmunin · How It Works · Data refreshed daily, snapshot 2026-11-08.