Shypd.aiThe largest open index of AI toolsVITA is an open-source AI Agents & Automation tool that enables real-time vision and speech interaction. VITA-1.5 significantly reduces interaction latency and enhances multimodal performance, supporting both English and Chinese.
Trending
Also listed in
About
VITA is an open-source project focused on achieving GPT-4o level real-time vision and speech interaction. The latest version, VITA-1.5, introduces significant advancements, including a reduction in end-to-end speech interaction latency from approximately 4 seconds to 1.5 seconds, enabling near-instant user experience. It also boasts enhanced multimodal performance, with average scores on benchmarks like MME, MMBench, and MathVista increasing from 59.8 to 70.8. VITA-1.5 refines speech processing capabilities, reducing ASR Word Error Rate from 18.4 to 7.5, and integrates an end-to-end TTS module. The tool supports both English and Chinese and provides instructions for setting up basic and real-time interactive demos, making it accessible for developers and researchers.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
