typhoon-7B-instruct-02-19-2024: benchmark results
Provider: Other. Access: Open.
Aggregate Rating 1411 ± 24, rank #5581 of 10916 rated models, from 33 benchmark results.
Strongest benchmark results
| Benchmark | Score | Metric | Percentile |
|---|---|---|---|
| Open LLM Leaderboard v1 - GSM8K | 58.45 | Accuracy (%) (5-shot) | 70.2 |
| Thai LLM NLG - iapp_squad_seacrowd_qa (ROUGE1) | 49.41 | ROUGE1 | 67.2 |
| Thai LLM NLG - iapp_squad_seacrowd_qa (ROUGE2) | 38.7 | ROUGE2 | 67.2 |
| Thai LLM NLG - iapp_squad_seacrowd_qa (ROUGEL) | 48.89 | ROUGEL | 67.2 |
| Open LLM Leaderboard v1 - WinoGrande | 78.61 | Accuracy (%) (5-shot) | 64.3 |
| Thai LLM NLG - flores200_eng_Latn_tha_Thai_seacrowd_t2t (BLEU) | 23.47 | BLEU | 61.2 |
| Thai LLM NLG - flores200_eng_Latn_tha_Thai_seacrowd_t2t (SacreBLEU) | 33.89 | SacreBLEU | 58.2 |
| Thai LLM NLG - flores200_eng_Latn_tha_Thai_seacrowd_t2t (chrF++) | 50.3 | chrF++ | 58.2 |
| Thai LLM NLG - flores200_tha_Thai_eng_Latn_seacrowd_t2t (BLEU) | 46.73 | BLEU | 56.7 |
| Thai LLM NLG - flores200_tha_Thai_eng_Latn_seacrowd_t2t (SacreBLEU) | 30.34 | SacreBLEU | 56.7 |
| Thai LLM - Roleplay | 6.75 | Rating (0-10) | 55.6 |
| Open LLM Leaderboard v1 - ARC Challenge | 61.95 | Normalized accuracy (%) (25-shot) | 55.2 |
Interactive version: theaggregate.ai/model?slug=typhoon-7b-instruct-02-19-2024 · How It Works · Data refreshed daily, snapshot 2026-11-08.