Shypd.aiThe largest open index of AI toolsRoboticsDiffusionTransformer (RDT-1B) is an open-source AI agent tool that provides a diffusion foundation model for bimanual robotic manipulation. It is pre-trained on over 1 million multi-robot episodes to predict robot actions from language instructions and RGB images.
Trending
Also listed in
About
RoboticsDiffusionTransformer (RDT-1B) is a 1-billion parameter diffusion foundation model specifically designed for bimanual robotic manipulation. It is pre-trained on an extensive dataset of over 1 million multi-robot episodes, making it the largest to date. RDT-1B can predict the next 64 robot actions based on language instructions and RGB images from up to three views. The model is compatible with various modern mobile manipulators, supporting single-arm to dual-arm configurations, joint to EEF control, and position to velocity commands, including wheeled locomotion. This repository provides the official PyTorch implementation, including model checkpoints, training and sampling scripts, and an example for real-robot deployment on the ALOHA dual-arm robot, where it has achieved state-of-the-art performance in dexterity, zero-shot generalizability, and few-shot learning.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
