AI Expertise
Open Models / VibeVoice-ASR
V

VibeVoice-ASR

Visit website

Description

VibeVoice-ASR is an open speech-to-text model for long recordings. Per the model card, it takes up to 60 minutes of continuous audio in a single pass (64K tokens) instead of cutting it into short chunks, and returns a structured transcript that says who spoke (speaker), when (timestamps) and what (content). You can pass your own hotwords, such as names and technical terms, to improve accuracy on specialized content. It supports more than 50 languages, needs no language setting and handles switching between languages inside a recording. The Hugging Face metadata lists about 8.7 billion parameters; the card does not state a VRAM requirement. The authors also published a separate edge CPU engine, VibeVoice-ASR-BitNet, and a streaming variant (see the GitHub repository). On the Open ASR Leaderboard (English short-form speech, nine test sets, checked 2026-10-20) the Transformers version has an average word error rate of 8.23%; the model is built for long recordings, so short clips do not show its main strength. Released 2026-01-21. The weights are public without any acceptance step under the MIT license, which allows commercial use. The authors also offer an official demo Space on Hugging Face, and the code is on GitHub. Date of check: 2026-10-20.

Pros and cons

Pros

  • Up to 60 minutes of audio in a single pass, per the model card
  • Transcript with speakers, timestamps and content in one output
  • Custom hotwords for names and technical terms
  • More than 50 languages, no language setting needed
  • MIT license, weights open without an acceptance step

Cons

  • About 8.7 billion parameters, a heavy model to run
  • The card does not state a VRAM requirement
  • Higher average error rate than the others on the short-clip Open ASR Leaderboard
  • This model has no streaming mode

Key facts

License
MIT
Commercial use
Allowed
Developer
Microsoft
Interface languages
English
Checked on
Oct 20, 2026

Editorial score

How strongly the AI Expertise editors recommend this open model for each of its tasks right now, on a 0–10 scale. The score combines output quality, capabilities, ease of launch, license openness and freshness.

Transcription

7.8 / 10
Output quality 7.8
Low High
Features 8.6
Basic Rich
Ease of launch 5.5
Hard Easy
License openness 10.0
Restricted Open
Freshness 6.0
Outdated Fresh