Shypd.aiThe largest open index of AI toolsVibeVoice is an open-source voice AI platform that offers both Text-to-Speech (TTS) and Automatic Speech Recognition (ASR) models. It supports long-form audio processing and real-time speech generation.
Trending
Also listed in
About
VibeVoice is an open-source frontier voice AI platform developed by Microsoft, featuring both Text-to-Speech (TTS) and Automatic Speech Recognition (ASR) models. A key innovation is its use of continuous speech tokenizers at an ultra-low frame rate of 7.5 Hz, which efficiently preserves audio fidelity while boosting computational efficiency for long sequences. The platform employs a next-token diffusion framework, leveraging a Large Language Model (LLM) for textual context and dialogue flow, and a diffusion head for high-fidelity acoustic details. VibeVoice-ASR can handle 60-minute long-form audio in a single pass, providing structured transcriptions with speaker identification, timestamps, and content, and supports over 50 languages. VibeVoice-Realtime-0.5B offers real-time text-to-speech with streaming text input and robust long-form speech generation.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
