AssemblyAI Author Benchmark - streaming - Diarization - cpWER - NOTSOFAR - cpWER: leaderboard

AssemblyAI Author Benchmark - streaming - Diarization - cpWER - NOTSOFAR - cpWER — AssemblyAI primary author evaluation, captured 2026-11-16; no fusion with another campaign sharing a corpus. Exact system versions and run ranges retained in source_systems_rosters. Prerecorded: public API defaults, auto language except explicitly pinned Cohere/Azure; models shown only when >=90% of files returned relative to AssemblyAI. Streaming: real-time SDK/WebSocket delivery, fixed language, final transcripts rather than partials, shared normalization. All streaming 0.00 means no data. Language WER/CER >=60 means unsupported. Language-specific boards join all-language and partial-language rosters but exclude incomparable means over different supported languages. Native percentage error; no upper cap of100. Metric: cpWER (%). Source: https://www.assemblyai.com/benchmarks

Metric: cpWER (%). Source: www.assemblyai.com. Saturation forecast: Rough model projection: around 2026. 12 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1Meta Muse Voice Transcribeassemblyai_author_benchmarks_2026 run35.07
2AssemblyAI Universal-3.5 Pro Realtimeassemblyai_author_benchmarks_2026 run40.61
3AssemblyAI Universal-3.6 Pro42.11
4Reson8 Reson8assemblyai_author_benchmarks_2026 run52.11
5Smallest AI Pulse53.26
6Azure Realtime STTassemblyai_author_benchmarks_2026 run54.06
7AWS Transcribe Streamingassemblyai_author_benchmarks_2026 run55.98
8Speechmatics Enhanced58.25
9Deepgram Nova-3assemblyai_author_benchmarks_2026 run58.3
10xAI Grok Streamingassemblyai_author_benchmarks_2026 run58.82
11Soniox Realtimeassemblyai_author_benchmarks_2026 run58.88
12Speechmatics Standard Realtimeassemblyai_author_benchmarks_2026 run70.49

Interactive version: theaggregate.ai/benchmark?slug=assemblyai-author-benchmark-streaming-diarization-cpwer-notsofar-cpwer · How It Works · Data refreshed daily, snapshot 2026-11-16.