internlm2-7B: benchmark results

Shanghai AI Lab's 7B InternLM2 base model (January 2024), notable for near-perfect needle-in-a-haystack retrieval at 200K-token context. Provider: Shanghai AI Lab. Released 2024-01-17. Access: Open.

Aggregate Rating 1409 ± 17, rank #1192 of 1656 rated models, from 60 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open Chinese LLM - WinoGrande70.01Accuracy (%)91.6
Open LLM Leaderboard v1 - WinoGrande83.82Accuracy (%) (5-shot)90.8
Open LLM Leaderboard v1 - MMLU65.24Accuracy (%) (5-shot)83.3
Open LLM Leaderboard - GPQA33.67Score83.2
Open LLM Leaderboard - BBH58.25Score79.4
Open Chinese LLM - HellaSwag65.44Accuracy (%)79
Open LLM Leaderboard - MuSR44Score78.1
Open LLM Leaderboard v1 - GSM8K63Accuracy (%) (5-shot)76.3
Open Chinese LLM Leaderboard59.83Official Nonzero-Task Mean (%)67.5
Open Chinese LLM - GSM8K49.66Accuracy (%)66
Open Chinese LLM - ARC Challenge54.52Accuracy (%)65.8
Open Chinese LLM - CMMLU57.52Accuracy (%)64.5

Interactive version: theaggregate.ai/model?slug=internlm2-7b · How It Works · Data refreshed daily, snapshot 2026-10-20.