In plain words: A network that builds sentence meaning by combining word meanings was trained on sentences with logical inferences, like getting "some animal walks" from "some dog walks." It handled new kinds of reasoning patterns well in nearly every case, showing learned representations can capture basic logic.
Abstract · Can recursive neural tensor networks learn logical reasoning?
Recursive neural network models and their accompanying vector representations for words have seen success in an array of increasingly semantically sophisticated tasks, but almost nothing is known about their ability to accurately capture the aspects of linguistic meaning that are necessary for interpretation or reasoning. To evaluate this, I train a recursive model on a new corpus of constructed examples of logical reasoning in short sentences, like the inference of "some animal walks" from "some dog walks" or "some cat walks," given that dogs and cats are animals. This model learns representations that generalize well to new types of reasoning pattern in all but a few cases, a result which is promising for the ability of learned representation models to capture logical reasoning.
Samuel R. Bowman
arXiv:1312.6192 · cs.CL, cs.LG · submitted Dec 21, 2013 · updated Feb 15, 2014
abstract · pdf · html · Submitted for presentation at ICLR 2014. Source code and data: http://goo.gl/PSyF5u