gemma-3-4B-pt Base: benchmark results

Google's pretrained 4B Gemma 3 base checkpoint (March 2025), multimodal with a SigLIP vision encoder and 128K context. Provider: Google. Released 2025-03-12. Access: Open.

Aggregate Rating 1423 ± 14, rank #1134 of 1656 rated models, from 644 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
EuroEval Slovak NLU - CSFD Sentiment SK65.92Matthews correlation coefficient (%)99
EuroEval Czech NLU - CSFD Sentiment68.79Matthews correlation coefficient (%)98.2
Open Arabic LLM - Aratrust Offensive95.65Accuracy (%)97.2
LA Leaderboard - EusProficiency Basque33.53Accuracy (%)94.1
LA Leaderboard - QNLI Basque57.98Accuracy (%)94.1
LA Leaderboard - XCOPA Basque58.8Accuracy (%)94.1
LA Leaderboard - xStoryCloze Basque59.43Accuracy (%)94.1
EuroEval Finnish NLU - Scandisent FI92.64Matthews correlation coefficient (%)93.8
EuroEval Ukrainian NLU - Cross Domain UK Reviews62.56Matthews correlation coefficient (%)93.8
LA Leaderboard - CoQCat74.37F1 (%)93.8
LA Leaderboard - BHTCv2 Basque38.24F1 (%)93.4
EuroEval Swedish NLU - Swerec79.23Matthews correlation coefficient (%)92

Interactive version: theaggregate.ai/model?slug=gemma-3-4b-pt-base · How It Works · Data refreshed daily, snapshot 2026-10-20.