Shypd.aiThe largest open index of AI toolsVideo-MME is a Testing & QA tool that provides a comprehensive evaluation benchmark for multi-modal Large Language Models (LLMs) in video analysis. It assesses MLLMs across diverse visual domains, temporal durations, and data modalities.
Trending
Also listed in
About
Video-MME is the first-ever comprehensive evaluation benchmark designed to assess the capabilities of Multi-modal Large Language Models (MLLMs) in video analysis. It covers a wide range of visual domains, temporal durations, and data modalities, including short, medium, and long-term videos (from 11 seconds to 1 hour). The benchmark comprises 900 videos totaling 254 hours and 2,700 human-annotated question-answer pairs. It integrates multi-modal inputs beyond video frames, such as subtitles and audios, to provide a full-spectrum evaluation. Video-MME is suitable for both image MLLMs and video MLLMs, offering a robust framework for evaluating model performance in understanding and processing sequential visual data.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
