ELYZA-Thinking-1.0-Qwen-32B: benchmark results

Provider: ELYZA. Released 2025-05-01. Access: Open.

Aggregate Rating 1546 ± 30, rank #1656 of 10870 rated models, from 42 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
JP-TL-Bench - English to Japanese - Hard9.06LT Score (0-10; Hard items only; anchored pairwise Bradley-T65.1
Swallow - Post-trained English - HellaSwag88.9Accuracy (%)62.7
JP-TL-Bench - English to Japanese8.88LT Score (0-10; anchored pairwise Bradley-Terry vs 20 Base S61.9
JP-TL-Bench - Japanese to English - Hard8.8LT Score (0-10; Hard items only; anchored pairwise Bradley-T60.3
JP-TL-Bench - English to Japanese - Easy8.86LT Score (0-10; Easy items only; anchored pairwise Bradley-T58.7
JP-TL-Bench - Japanese to English8.34LT Score (0-10; anchored pairwise Bradley-Terry vs 20 Base S57.1
Swallow - Post-trained Japanese - WMT20 Ja-En21.6BLEU56
Swallow - Post-trained Japanese - JamC-QA50.3Accuracy (%)50.7
JP-TL-Bench - Japanese to English - Easy7.73LT Score (0-10; Easy items only; anchored pairwise Bradley-T46
Swallow - Post-trained Japanese - WMT20 En-Ja23.7BLEU45.5
Swallow - Japanese MT-Bench - Math94.3Judge Score (normalized, %)44.8
Swallow - English MT-Bench - Extraction77.8Judge Score (normalized, %)41.8

Interactive version: theaggregate.ai/model?slug=elyza-thinking-1-0-qwen-32b · How It Works · Data refreshed daily, snapshot 2026-11-12.