about
Neural Turing Machines (2014) (arxiv.org)
4 points by peter_d_sherman 20 days ago | hide | past | pdf | discuss on HN

In plain words: A neural network is hooked up to an external memory it can read and write, like a computer's, and the whole setup is trained so it learns what to store and retrieve. From just input-output examples, it figured out simple algorithms like copying, sorting, and recalling, which ordinary networks cannot do.

Abstract · Neural Turing Machines

We extend the capabilities of neural networks by coupling them to external memory resources, which they can interact with by attentional processes. The combined system is analogous to a Turing Machine or Von Neumann architecture but is differentiable end-to-end, allowing it to be efficiently trained with gradient descent. Preliminary results demonstrate that Neural Turing Machines can infer simple algorithms such as copying, sorting, and associative recall from input and output examples.

Alex Graves, Greg Wayne, Ivo Danihelka
arXiv:1410.5401 · cs.NE · submitted Oct 20, 2014 · updated Dec 10, 2014
abstract · pdf · html

add comment on HN
Also discussed: Feb 2019 (1 point, 0 comments) · May 2016 (55 points, 27 comments) · Jan 2016 (2 points, 0 comments) · Oct 2014 (8 points, 1 comment) · Oct 2014 (60 points, 7 comments) · Oct 2014 (75 points, 11 comments)