internlm2-chat-20B: benchmark results
Shanghai AI Lab's 20B InternLM2 chat model with 200K context, tool use and code-interpreter support, from the January 2024 InternLM2 release. Provider: Shanghai AI Lab. Released 2024-01-17. Access: Open.
Aggregate Rating 1450 ± 12, rank #999 of 1656 rated models, from 235 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| OpenCompass Language - Content Summarization - Chinese (CompassBench 2405) | 33.2 | Score (%) | 100 |
| Open PL LLM - KLEJ NER (multiple choice, 5-shot) | 64.67 | Accuracy (%) | 99.7 |
| Open CoT - LSAT Logical Reasoning | 22.35 | CoT Gain (%) | 97.7 |
| Open CoT - LSAT Reading Comprehension | 24.16 | CoT Gain (%) | 97.7 |
| Open CoT - LogiQA 2 | 17.62 | CoT Gain (%) | 97.7 |
| Open CoT Leaderboard | 16.11 | Average CoT Gain (%) | 97.7 |
| SALAD-Bench Base | 98.15 | Safety Score (%) | 97 |
| OpenCompass Language - Content Summarization - English (CompassBench 2405) | 38.2 | Score (%) | 94.7 |
| OpenCompass Subjective - Creation (CompassBench 2404) | 51.9 | Score (%) | 94 |
| Open PL LLM - PolEmo2-IN (multiple choice, 5-shot) | 86.29 | Accuracy (%) | 90.7 |
| Open CoT - LogiQA | 8.15 | CoT Gain (%) | 90.5 |
| OpenCompass Subjective - Creation - Chinese (CompassBench 2405) | 50.4 | Score (%) | 89.5 |
Interactive version: theaggregate.ai/model?slug=internlm2-chat-20b · How It Works · Data refreshed daily, snapshot 2026-10-20.