In plain words: A plan to build an open assistant inside Minecraft, where it must follow instructions and learn from chat while playing in a rich, open world. Minecraft is proposed as a place to test this because everyday conversation there pushes language understanding past scripted tasks.

Abstract

In this document we describe a rationale for a research program aimed at building an open "assistant" in the game Minecraft, in order to make progress on the problems of natural language understanding and learning from dialogue.

Arthur Szlam, Jonathan Gray, Kavya Srinet, Yacine Jernite, Armand Joulin, Gabriel Synnaeve, Douwe Kiela, Haonan Yu, Zhuoyuan Chen, Siddharth Goyal, Demi Guo, Danielle Rothermel, et al.
arXiv:1907.09273 · cs.AI, cs.CL · submitted Jul 22, 2019 · updated Jul 25, 2019
abstract · pdf · html