recurrentgemma-2B: benchmark results

Provider: Google. Released 2024-04-11. Access: Open.

Unified ELO 1225 ± 24, rank #2610 of 2656 rated models, from 22 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open LLM Leaderboard - IFEval30.17Score27.7
Open Portuguese LLM - ASSIN2 RTE75.13Macro F1 (%)27.3
Open Portuguese LLM - BLUEX26.15Accuracy (%)22.5
Open Portuguese LLM - OAB Exams27.11Accuracy (%)21.5
Open Portuguese LLM - ENEM21.69Accuracy (%)18.3
Open Medical LLM - PubMedQA64.6Accuracy (%)17.6
Open Portuguese LLM - FaQuAD NLI43.97Macro F1 (%)17.1
Open LLM Leaderboard - MATH Level 52.04Score14.3
Open Medical LLM - MMLU Professional Medicine29.78Accuracy (%)13.1
Open Medical LLM - MMLU Medical Genetics36Accuracy (%)12.5
Open Medical LLM32.94Average Accuracy (%)11.9
Open Medical LLM - MMLU College Medicine26.01Accuracy (%)11.9

Interactive version: theaggregate.ai/model?slug=recurrentgemma-2b · How It Works · Data refreshed daily, snapshot 2026-09-19.