ModernBERT-large: benchmark results

Provider: Answer.AI & LightOn. Released 2024-12-19.

Aggregate Rating 1355 ± 35, rank #7580 of 10916 rated models, from 180 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Danish NLU - ScaLA DA65.17Matthews correlation coefficient (%)92.6
EuroEval Norwegian NLU - ScaLA NB64.31Matthews correlation coefficient (%)88.6
EuroEval Norwegian NLU - ScaLA NN50.4Matthews correlation coefficient (%)86.9
EuroEval Hungarian NLU - Szeged NER71.39Micro F1 excluding MISC (%)84.7
EuroEval Faroese NLU - ScaLA FO19.11Matthews correlation coefficient (%)82.7
EuroEval Faroese NLU - FONE74.04Micro F1 excluding MISC (%)80.2
EuroEval English NLU - CoNLL EN78.96Micro F1 excluding MISC (%)80.1
EuroEval Swedish NLU - ScaLA SV58.15Matthews correlation coefficient (%)79.6
EuroEval Norwegian56.65Average Score (%)79.1
EuroEval Icelandic NLU - ScaLA IS23.64Matthews correlation coefficient (%)78.3
EuroEval Norwegian NLU56.65NLU Average Score (%)68.9
EuroEval Icelandic36.45Average Score (%)68.3

Interactive version: theaggregate.ai/model?slug=modernbert-large · How It Works · Data refreshed daily, snapshot 2026-11-08.