about
Investigating Capsule Networks with Dynamic Routing for Text Classification (arxiv.org)
3 points by tianyicui on Apr 3, 2018 | hide | past | pdf | discuss on HN

In plain words: Capsule networks group words into small packets that vote on the label; three fixes keep noisy packets from spoiling the vote. On six text datasets they beat the strongest usual models on four, and helped most when moving from single-label to multi-label tasks.

Abstract

In this study, we explore capsule networks with dynamic routing for text classification. We propose three strategies to stabilize the dynamic routing process to alleviate the disturbance of some noise capsules which may contain "background" information or have not been successfully trained. A series of experiments are conducted with capsule networks on six text classification benchmarks. Capsule networks achieve state of the art on 4 out of 6 datasets, which shows the effectiveness of capsule networks for text classification. We additionally show that capsule networks exhibit significant improvement when transfer single-label to multi-label text classification over strong baseline methods. To the best of our knowledge, this is the first work that capsule networks have been empirically investigated for text modeling.

Wei Zhao, Jianbo Ye, Min Yang, Zeyang Lei, Suofei Zhang, Zhou Zhao
arXiv:1804.00538 · cs.CL, cs.AI · submitted Mar 29, 2018 · updated Sep 3, 2018
abstract · pdf · html · 12 pages

add comment on HN