Shypd.aiThe largest open index of AI toolsSegment-and-Track-Anything is an open-source video editing tool that tracks and segments any objects in videos, either automatically or interactively. It utilizes SAM for key-frame segmentation and AOT for efficient tracking.
Trending
Also listed in
About
Segment-and-Track-Anything is an open-source project dedicated to tracking and segmenting any objects in videos, offering both automatic and interactive methods. It leverages the Segment Anything Model (SAM) for key-frame segmentation and Associating Objects with Transformers (AOT) for efficient multi-object tracking and propagation. The tool's pipeline allows for dynamic and automatic detection and segmentation of new objects by SAM, while DeAOT handles the tracking of all identified objects. Recent features include audio-grounding for tracking sound-making objects, integration with Grounding-DINO for detecting new objects in key frames, and advanced memory management for long videos. It also provides an interactive WebUI with text prompts, click, and stroke-based interactions for object selection and refinement.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
