about
The AI revolution is coming to robots: how will it change them? (arxiv.org)
1 point by rntn on May 28, 2024 | hide | past | pdf | discuss on HN

In plain words: A huge collection of 76,000 robot arm demonstrations gathered by 50 people in 564 real-world scenes across three continents, covering 84 tasks. Robots trained on this mix did better and handled new situations more reliably than robots trained on the usual small, single-room datasets.

Abstract · DROID: A Large-Scale In-The-Wild Robot Manipulation Dataset

The creation of large, diverse, high-quality robot manipulation datasets is an important stepping stone on the path toward more capable and robust robotic manipulation policies. However, creating such datasets is challenging: collecting robot manipulation data in diverse environments poses logistical and safety challenges and requires substantial investments in hardware and human labour. As a result, even the most general robot manipulation policies today are mostly trained on data collected in a small number of environments with limited scene and task diversity. In this work, we introduce DROID (Distributed Robot Interaction Dataset), a diverse robot manipulation dataset with 76k demonstration trajectories or 350 hours of interaction data, collected across 564 scenes and 84 tasks by 50 data collectors in North America, Asia, and Europe over the course of 12 months. We demonstrate that training with DROID leads to policies with higher performance and improved generalization ability. We open source the full dataset, policy learning code, and a detailed guide for reproducing our robot hardware setup.

Alexander Khazatsky, Karl Pertsch, Suraj Nair, Ashwin Balakrishna, Sudeep Dasari, Siddharth Karamcheti, Soroush Nasiriany, Mohan Kumar Srirama, Lawrence Yunliang Chen, Kirsty Ellis, Peter David Fagan, Joey Hejna, et al.
arXiv:2403.12945 · cs.RO · submitted Mar 19, 2024 · updated Apr 22, 2025
abstract · pdf · html · Project website: https://droid-dataset.github.io/

add comment on HN