In plain words: A system watches frames from Minecraft gameplay videos and uses a deep image-recognition network to write commentary, so Let's Play videos can get automatic narration. Compared with an earlier attempt, it generated artificial commentary for the game.

Abstract

Let's Plays of video games represent a relatively unexplored area for experimental AI in games. In this short paper, we discuss an approach to generate automated commentary for Let's Play videos, drawing on convolutional deep neural networks. We focus on Let's Plays of the popular game Minecraft. We compare our approach and a prior approach and demonstrate the generation of automated, artificial commentary.

Shukan Shah, Matthew Guzdial, Mark O. Riedl
arXiv:1909.02195 · cs.CL, cs.AI · submitted Sep 5, 2019 · updated Sep 6, 2019
abstract · pdf · html · 5 pages, 2 figures