about
Towards AI-Complete Question Answering, Using Deep Learning (arxiv.org)
6 points by ilyaeck on Feb 22, 2015 | hide | past | pdf | 1 comment on HN

In plain words: A set of small question-answering tests checks one reasoning skill at a time—chaining facts, induction, deduction—as stepping stones toward a machine that can hold a conversation. An upgraded memory-based reading model solves some of the tests but not all.

Abstract · Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks

One long-term goal of machine learning research is to produce methods that are applicable to reasoning and natural language, in particular building an intelligent dialogue agent. To measure progress towards that goal, we argue for the usefulness of a set of proxy tasks that evaluate reading comprehension via question answering. Our tasks measure understanding in several ways: whether a system is able to answer questions via chaining facts, simple induction, deduction and many more. The tasks are designed to be prerequisites for any system that aims to be capable of conversing with a human. We believe many existing learning systems can currently not solve them, and hence our aim is to classify these tasks into skill sets, so that researchers can identify (and then rectify) the failings of their systems. We also extend and improve the recently introduced Memory Networks model, and show it is able to solve some, but not all, of the tasks.

Jason Weston, Antoine Bordes, Sumit Chopra, Alexander M. Rush, Bart van Merriënboer, Armand Joulin, Tomas Mikolov
arXiv:1502.05698 · cs.AI, cs.CL, stat.ML · submitted Feb 19, 2015 · updated Dec 31, 2015
abstract · pdf · html

add comment on HN
Also discussed: Feb 2015 (2 points, 0 comments)

Looks like the FB lab opened access to the tasks database for training. Also, when did Mikolov move leave Google for Facebook?