GigaChat 2 Lite: benchmark results

Provider: Other.

Aggregate Rating 1468 ± 38, rank #2880 of 10916 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
MERA Code - ruCodeEval30.49pass@1 (%)52.3
MERA Code - CodeCorrectness72.08Accuracy (%)50.8
MERA Code - ruHumanEval25.12pass@1 (%)49.2
MERA Code - UnitTests16.7CodeBLEU (%)36.9
MERA Code0.24Total score34.6
MERA Code - RealCode10.1pass@1 (%)32.3
MERA Code - ruCodeReviewer1.89Top-1 Accuracy (%)29.2
MERA Code - stRuCom13.88chrF (%)24.6
LLM Arena RU929Arena Elo24.3
MERA Code - JavaTestGen5.73pass@1 (%)23.8
MERA Code - CodeLinterEval31.36pass@1 (%)23.1
MERA Code - RealCodeJava18.12pass@1 (%)23.1

Interactive version: theaggregate.ai/model?slug=gigachat-2-lite · How It Works · Data refreshed daily, snapshot 2026-11-08.