AirCaps A5S Async v1 Benchmark - Internal seven recordings - cpWER: leaderboard
AirCaps A5S Async v1 Benchmark - Internal seven recordings - cpWER — AirCaps A5S Async v1 author comparison, November2026. Same 16kHz mono16bit WAV full recordings and native API defaults, with only exact model, language and diarization set. English language is en; Mandarin datasets use their native language. Meta switches from file to realtime above10min with same model/mode. Other documented request limits use fewest equal chunks, two-minute overlap and reference-blind stitching. Failed recordings are empty transcripts/all deletions. References and hypotheses receive OpenASR normalization plus ellipsis removal and split-numeral joining, per speaker runs, then MeetEval minimum-permutation error. Nvidia is BF16 self-hosted1xH100, temperature0,top_p1,seed0,reasoningoff and its published benchmark prompt; NVIDIA generation-loop guardrail retained. Model runs and native request settings are attached. AirCaps accuracy runNovember6; peersNovember1–2. This campaign is distinct from VoiceArena or another evaluator using the same corpus. AirCaps self-evaluation on seven private recordings,3.4h,3–5speakers. References begin as ElevenLabsScribev2 output; five corrected only for names/terms, two human reviewed/corrected. Two recordings use selected portions. Only scores published; preserve this reference and population provenance. Metric: cpWER (%). Source: https://github.com/aircaps/a5s-async-v1-benchmark
Metric: cpWER (%). Source: github.com. Saturation forecast: Rough model projection: around 2026. 9 models tracked. Updated 16 Nov 2026.
Top models
| # | Model | Score | Overall rank |
|---|---|---|---|
| 1 | AirCaps A5S Async v1 | 21.89 | |
| 2 | Muse Voice Transcribe 1.0 | 30.85 | |
| 3 | AssemblyAI Universal-3.5 Pro | 31.82 | |
| 4 | Nemotron 3.5 Transcribe | 33.8 | |
| 5 | MAI-Transcribe-2 | 43.8 | |
| 6 | Scribe v2 | 50.8 | |
| 7 | Grok Voice Transcribe 2.0 | 52.65 | |
| 8 | Gemini 3.5 Transcribe | 53.05 | |
| 9 | Deepgram Nova 3 | 82.26 |
Interactive version: theaggregate.ai/benchmark?slug=aircaps-a5s-async-v1-benchmark-internal-seven-recordings-cpwer · How It Works · Data refreshed daily, snapshot 2026-11-16.