internlm2-1.8B: benchmark results

Shanghai AI Lab's InternLM2-1.8B, the foundation base model in a three-version 1.8B family (base, Chat-SFT and Chat), supporting contexts up to 200,000 characters. Provider: Shanghai AI Lab. Released 2024-01-31. Access: Open.

Aggregate Rating 1237 ± 37, rank #1552 of 1654 rated models, from 38 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
Open PL LLM - PSC (multiple choice, 5-shot)44.6Binary F1 (%)30.7
Open LLM Leaderboard - MuSR38.13Score30
Open Portuguese LLM - FaQuAD NLI46.68Macro F1 (%)29
Open Portuguese LLM - BLUEX31.71Accuracy (%)27.8
Open PL LLM - PSC (generative, 5-shot)76.07Binary F1 (%)26.8
Open Portuguese LLM - OAB Exams30.75Accuracy (%)26.8
Open Portuguese LLM - ASSIN2 RTE72.34Macro F1 (%)26.1
Open Portuguese LLM - ENEM29.11Accuracy (%)23.7
Open LLM Leaderboard - BBH38.8Score23
Open PL LLM - EQ-Bench2.83EQ-Bench Score20.8
Open PL LLM - DYK (generative, 5-shot)28.97Binary F1 (%)19.5
Open PL LLM Leaderboard3.15Average Score (%)18.9

Interactive version: theaggregate.ai/model?slug=internlm2-1-8b · How It Works · Data refreshed daily, snapshot 2026-10-24.