EuroVLM-1.7B-Preview: benchmark results

Provider: Other. Access: Open.

Aggregate Rating 1248 ± 33, rank #9272 of 10916 rated models, from 96 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval German NLU - Sb10K48.5Matthews correlation coefficient (%)42.5
EuroEval Danish NLU - Angry Tweets39.16Matthews correlation coefficient (%)37.5
EuroEval Swedish NLU - Swerec70.8Matthews correlation coefficient (%)36.4
EuroEval Faroese NLU - FoSent10.17Matthews correlation coefficient (%)32.3
EuroEval Finnish NLU - ScaLA FI3.33Matthews correlation coefficient (%)28
EuroEval Icelandic NLU - ScaLA IS0.14Matthews correlation coefficient (%)25.4
EuroEval Norwegian NLU - Norec23.6Matthews correlation coefficient (%)24.1
EuroEval Danish Knowledge - Danish Citizen Tests17.18MCC (x100)23.6
EuroEval Italian NLU - Sentipolc1633Matthews correlation coefficient (%)23.1
EuroEval Spanish NLU - ScaLA ES0.39Matthews correlation coefficient (%)23.1
EuroEval English NLU - SST-553.73Matthews correlation coefficient (%)22.8
EuroEval Spanish NLU - Sentiment Headlines ES21.81Matthews correlation coefficient (%)22

Interactive version: theaggregate.ai/model?slug=eurovlm-1-7b-preview · How It Works · Data refreshed daily, snapshot 2026-11-08.