about
Semantic expressive capacity with bounded memory (arxiv.org)
1 point by sel1 on Jun 30, 2019 | hide | past | pdf | discuss on HN

In plain words: The study proves a limit on how much memory a system needs to map sentences to their meanings. Systems that build meaning strictly in word order must remember an unlimited number of spots, while ones that can jump around need only bounded memory.

Abstract

We investigate the capacity of mechanisms for compositional semantic parsing to describe relations between sentences and semantic representations. We prove that in order to represent certain relations, mechanisms which are syntactically projective must be able to remember an unbounded number of locations in the semantic representations, where nonprojective mechanisms need not. This is the first result of this kind, and has consequences both for grammar-based and for neural systems.

Antoine Venant, Alexander Koller
arXiv:1906.11752 · cs.CL, cs.LO · submitted Jun 27, 2019
abstract · pdf · html · Accepted at ACL 2019

add comment on HN