KronLSTM Study - Language - HellaSwag: leaderboard

KronLSTM (2026): matched research-trained 1.5B models on 100B pretraining tokens, linear and hybrid architectures kept distinct; zero/few-shot downstream task protocol from the paper. Architecture names do not identify unrelated public Mamba, mLSTM or GDN checkpoints. Accuracy (%); higher is better.

Metric: Accuracy (%). Source: arxiv.org. Saturation forecast: Rough model projection: around 2026. 12 models tracked.

Top models

#ModelScoreOverall rank
1KronLSTM Study KronLSTM 1.5B Hybrid (100B tokens)59.8
2KronLSTM Study KronLSTM 1.5B Linear (100B tokens)59.19
3KronLSTM Study GDN 1.5B Hybrid (100B tokens)58.46
4KronLSTM Study GDN-2 1.5B Hybrid (100B tokens)58.35
5KronLSTM Study Mamba-3 1.5B Hybrid (100B tokens)58.14
6KronLSTM Study KDA 1.5B Hybrid (100B tokens)57.93
7KronLSTM Study KDA 1.5B Linear (100B tokens)57.48
8KronLSTM Study GDN-2 1.5B Linear (100B tokens)57.45
9KronLSTM Study Mamba-3 1.5B Linear (100B tokens)57.3
10KronLSTM Study GDN 1.5B Linear (100B tokens)57

Interactive version: theaggregate.ai/benchmark?slug=kronlstm-study-language-hellaswag · How It Works · Data refreshed daily, snapshot 2026-10-21.