about
Ask Me Anything: Dynamic Memory Networks for Natural Language Processing (arxiv.org)
35 points by drewvolpe on Jun 25, 2015 | hide | past | pdf | 5 comments on HN

In plain words: A network reads a passage and a question, loops over the text, each pass focusing on what the question and past passes point to, building a memory it turns into an answer. It beat the best earlier systems on story questions, sentiment, and word tagging.

Abstract

Most tasks in natural language processing can be cast into question answering (QA) problems over language input. We introduce the dynamic memory network (DMN), a neural network architecture which processes input sequences and questions, forms episodic memories, and generates relevant answers. Questions trigger an iterative attention process which allows the model to condition its attention on the inputs and the result of previous iterations. These results are then reasoned over in a hierarchical recurrent sequence model to generate answers. The DMN can be trained end-to-end and obtains state-of-the-art results on several types of tasks and datasets: question answering (Facebook's bAbI dataset), text classification for sentiment analysis (Stanford Sentiment Treebank) and sequence modeling for part-of-speech tagging (WSJ-PTB). The training for these different tasks relies exclusively on trained word vector representations and input-question-answer triplets.

Ankit Kumar, Ozan Irsoy, Peter Ondruska, Mohit Iyyer, James Bradbury, Ishaan Gulrajani, Victor Zhong, Romain Paulus, Richard Socher
arXiv:1506.07285 · cs.CL, cs.LG, cs.NE · submitted Jun 24, 2015 · updated Mar 5, 2016
abstract · pdf · html

add comment on HN
Also discussed: Jun 2015 (12 points, 2 comments)

Such an interesting paper that I came across just now from a tweet.

Are there any other papers around DMN for Q&A, or particularly other use cases of DMN?

I skimmed through, but I can't see any radically different from Facebook's Memory Networks. Anyone else see a big difference?
using gated recurrent net + temporal context
Took me a while to understand "Ask Me Anything", I thought it was AMA from author.