recurrentgemma-2B: benchmark results
Google's RecurrentGemma 2B, a recurrent-architecture model in the Gemma family released under the Gemma license in April 2024; the linked model card provides no further details here. Provider: Google. Released 2024-04-11. Access: Open.
Aggregate Rating 1187 ± 35, rank #1570 of 1635 rated models, from 22 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard - IFEval | 30.17 | Score | 27.7 |
| Open Portuguese LLM - ASSIN2 RTE | 75.13 | Macro F1 (%) | 27.3 |
| Open Portuguese LLM - BLUEX | 26.15 | Accuracy (%) | 22.5 |
| Open Portuguese LLM - OAB Exams | 27.11 | Accuracy (%) | 21.4 |
| Open Portuguese LLM - ENEM | 21.69 | Accuracy (%) | 18.2 |
| Open Medical LLM - PubMedQA | 64.6 | Accuracy (%) | 17.2 |
| Open Portuguese LLM - FaQuAD NLI | 43.97 | Macro F1 (%) | 17.1 |
| Open LLM Leaderboard - MATH Level 5 | 2.04 | Score | 14.2 |
| Open Medical LLM - MMLU Professional Medicine | 29.78 | Accuracy (%) | 12.5 |
| Open Medical LLM - MMLU Medical Genetics | 36 | Accuracy (%) | 12 |
| Open LLM Leaderboard - BBH | 31.97 | Score | 11.7 |
| Open Medical-LLM Leaderboard (BenchmarkList) | 32.94 | Medical average (%) | 11.7 |
Interactive version: theaggregate.ai/model?slug=recurrentgemma-2b · How It Works · Data refreshed daily, snapshot 2026-11-05.