about
Solving Rubik's Cube with a Robot Hand (arxiv.org)
1 point by Jimmc414 on Jan 3, 2023 | hide | past | pdf | discuss on HN

In plain words: A training trick keeps inventing more varied and harder simulated worlds, instead of using one fixed set of fake conditions, so a robot hand's skills survive the jump to reality. Using only simulated practice, a five-fingered hand solved a real Rubik's cube.

Abstract

We demonstrate that models trained only in simulation can be used to solve a manipulation problem of unprecedented complexity on a real robot. This is made possible by two key components: a novel algorithm, which we call automatic domain randomization (ADR) and a robot platform built for machine learning. ADR automatically generates a distribution over randomized environments of ever-increasing difficulty. Control policies and vision state estimators trained with ADR exhibit vastly improved sim2real transfer. For control policies, memory-augmented models trained on an ADR-generated distribution of environments show clear signs of emergent meta-learning at test time. The combination of ADR with our custom robot platform allows us to solve a Rubik's cube with a humanoid robot hand, which involves both control and state estimation problems. Videos summarizing our results are available: https://openai.com/blog/solving-rubiks-cube/

OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litwin, Bob McGrew, Arthur Petron, Alex Paino, Matthias Plappert, Glenn Powell, Raphael Ribas, Jonas Schneider, et al.
arXiv:1910.07113 · cs.LG, cs.AI, cs.CV, cs.RO, stat.ML · submitted Oct 16, 2019
abstract · pdf · html

add comment on HN