about
Memory Networks (arxiv.org)
18 points by mlla on Nov 1, 2014 | hide | past | pdf | discuss on HN

In plain words: A model keeps a long-term memory it can read and write like a knowledge base, with reasoning parts trained alongside it to answer questions. On a simulated-world task, it chained several stored sentences to answer questions needing the meaning of verbs.

Abstract

We describe a new class of learning models called memory networks. Memory networks reason with inference components combined with a long-term memory component; they learn how to use these jointly. The long-term memory can be read and written to, with the goal of using it for prediction. We investigate these models in the context of question answering (QA) where the long-term memory effectively acts as a (dynamic) knowledge base, and the output is a textual response. We evaluate them on a large-scale QA task, and a smaller, but more complex, toy task generated from a simulated world. In the latter, we show the reasoning power of such models by chaining multiple supporting sentences to answer questions that require understanding the intension of verbs.

Jason Weston, Sumit Chopra, Antoine Bordes
arXiv:1410.3916 · cs.AI, cs.CL, stat.ML · submitted Oct 15, 2014 · updated Nov 29, 2015
abstract · pdf · html

add comment on HN
Also discussed: Mar 2015 (1 point, 0 comments) · Feb 2015 (2 points, 0 comments)