AssemblyAI Author Benchmark - streaming - Caller entity classes - Phone - Normalized entity error rate: leaderboard

AssemblyAI Author Benchmark - streaming - Caller entity classes - Phone - Normalized entity error rate — AssemblyAI primary author evaluation, captured 2026-11-16; no fusion with another campaign sharing a corpus. Exact system versions and run ranges retained in source_systems_rosters. Prerecorded: public API defaults, auto language except explicitly pinned Cohere/Azure; models shown only when >=90% of files returned relative to AssemblyAI. Streaming: real-time SDK/WebSocket delivery, fixed language, final transcripts rather than partials, shared normalization. All streaming 0.00 means no data. Language WER/CER >=60 means unsupported. Language-specific boards join all-language and partial-language rosters but exclude incomparable means over different supported languages. Native percentage error; no upper cap of100. Metric: Normalized entity error rate (%). Source: https://www.assemblyai.com/benchmarks

Metric: Normalized entity error rate (%). Source: www.assemblyai.com. Saturation forecast: Rough model projection: around 2026. 22 models tracked. Updated 16 Nov 2026.

Top models

#ModelSettingScoreOverall rank
1AssemblyAI Universal-3.6 Pro2.4
2AssemblyAI Universal-3.5 Proassemblyai_author_benchmarks_2026 run2.6
3Soniox Realtimeassemblyai_author_benchmarks_2026 run2.7
4AWS Transcribeassemblyai_author_benchmarks_2026 run3.1
5Speechmatics Enhanced3.2
6ElevenLabs Scribe v2assemblyai_author_benchmarks_2026 run3.4
7Deepgram Nova-3assemblyai_author_benchmarks_2026 run4.5
8Speechmatics Standardassemblyai_author_benchmarks_2026 run6.8
9Google Gemini 3.5 Liveassemblyai_author_benchmarks_2026 run7.3
10Mistral Voxtral Miniassemblyai_author_benchmarks_2026 run7.7
11Azureassemblyai_author_benchmarks_2026 run8.7
12Deepgram Flux Multiassemblyai_author_benchmarks_2026 run9.3
13Zoom Scribe (Live)assemblyai_author_benchmarks_2026 run9.6
14Meta Muse Voice Transcribeassemblyai_author_benchmarks_2026 run10
15Deepgram Flux ENassemblyai_author_benchmarks_2026 run11.5

Interactive version: theaggregate.ai/benchmark?slug=assemblyai-author-benchmark-streaming-caller-entity-classes-phone-normalized-entity-error-rate · How It Works · Data refreshed daily, snapshot 2026-11-16.