gemma-2-27B-it-FP8-Dynamic: benchmark results

Provider: Google. Released 2024-06-27. Access: Open.

Aggregate Rating 1593 ± 33, rank #1086 of 10916 rated models, from 104 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Norwegian NLU - Norec67.19Matthews correlation coefficient (%)99.7
EuroEval Danish NLU - Angry Tweets58.86Matthews correlation coefficient (%)95.9
EuroEval Italian NLU - Sentipolc1666.77Matthews correlation coefficient (%)93.5
EuroEval Dutch NLU - DBRD92.02Matthews correlation coefficient (%)92
EuroEval Swedish NLU - Swerec79.21Matthews correlation coefficient (%)91.4
EuroEval German NLU - Sb10K58.36Matthews correlation coefficient (%)89.2
EuroEval Italian Common Sense Reasoning70.05Common Sense Reasoning Average Score (%)88.3
EuroEval English NLU - SST-568.81Matthews correlation coefficient (%)88
EuroEval Spanish NLU - Sentiment Headlines ES49.23Matthews correlation coefficient (%)87.7
EuroEval Danish67.8Average Score (%)87.1
EuroEval French NLU - Allocine94.96Matthews correlation coefficient (%)85.5
EuroEval Finnish NLU - Scandisent FI92.05Matthews correlation coefficient (%)85.2

Interactive version: theaggregate.ai/model?slug=gemma-2-27b-it-fp8-dynamic · How It Works · Data refreshed daily, snapshot 2026-11-08.