LiT Qwen3-30B-A3B Instruct (checkpoint unspecified): benchmark results

Provider: Other.

Aggregate Rating 1494 ± 41, rank #2459 of 10916 rated models, from 15 benchmark results.

Strongest benchmark results

BenchmarkScoreMetricPercentile
LiT (Lost in Translation) - STEM Abstracts19.4MQM>=80 rate (%): share of round-trip translations whose bac9.5
LiT (Lost in Translation)21.4MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Core Semantics30.7MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Discourse Coherence28MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Humanities Abstracts14.4MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Implicit Content23.2MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Informal Text3.4MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Pragmatic Inference25.5MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) - Social Interaction26.8MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) Robustness14MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) Robustness - Conceptual and Abstract Nuance25MQM>=80 rate (%): share of round-trip translations whose bac4.8
LiT (Lost in Translation) Robustness - Idioms and Cultural Metaphors7.3MQM>=80 rate (%): share of round-trip translations whose bac4.8

Interactive version: theaggregate.ai/model?slug=lit-qwen3-30b-a3b-instruct-checkpoint-unspecified · How It Works · Data refreshed daily, snapshot 2026-11-08.