AssemblyAI Author Benchmark - streaming - FLEURS multilingual - Japanese* - CER: leaderboard

AssemblyAI Author Benchmark - streaming - FLEURS multilingual - Japanese* - CER — AssemblyAI primary author evaluation, captured 2026-11-16; no fusion with another campaign sharing a corpus. Exact system versions and run ranges retained in source_systems_rosters. Prerecorded: public API defaults, auto language except explicitly pinned Cohere/Azure; models shown only when >=90% of files returned relative to AssemblyAI. Streaming: real-time SDK/WebSocket delivery, fixed language, final transcripts rather than partials, shared normalization. All streaming 0.00 means no data. Language WER/CER >=60 means unsupported. Language-specific boards join all-language and partial-language rosters but exclude incomparable means over different supported languages. Native percentage error; no upper cap of100. CER for Japanese/Chinese/Korean as marked by source. Metric: CER (%). Source: https://www.assemblyai.com/benchmarks

Metric: CER (%). Source: www.assemblyai.com. Saturation forecast: Rough model projection: around 2026. 21 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Google Gemini 3.5 Liveassemblyai_author_benchmarks_2026 run5
2Soniox Realtimeassemblyai_author_benchmarks_2026 run5.8
3Zoom Scribe (Live)assemblyai_author_benchmarks_2026 run6.2
4AssemblyAI Universal-3.6 Pro6.3
5AssemblyAI Universal-3.5 Proassemblyai_author_benchmarks_2026 run6.5
6AWS Transcribeassemblyai_author_benchmarks_2026 run7
7Azureassemblyai_author_benchmarks_2026 run8.6
8ElevenLabs Scribe v2assemblyai_author_benchmarks_2026 run8.6
9Mistral Voxtral Miniassemblyai_author_benchmarks_2026 run9.6
10Meta Muse Voice Transcribeassemblyai_author_benchmarks_2026 run9.8
11Smallest AI Pulse12.7
12OpenAI GPT Realtimeassemblyai_author_benchmarks_2026 run13.4
13Deepgram Fluxassemblyai_author_benchmarks_2026 run13.6
14OpenAI GPT-4o mini Transcribeassemblyai_author_benchmarks_2026 run15.4
15OpenAI GPT-4o Transcribeassemblyai_author_benchmarks_2026 run16.1

Interactive version: theaggregate.ai/benchmark?slug=assemblyai-author-benchmark-streaming-fleurs-multilingual-japanese-star-cer · How It Works · Data refreshed daily, snapshot 2026-11-16.