In plain words: Each capsule switches on based on the benefit of using the capsules below it versus the cost of ignoring them, a rule that works for images and text. On a 3D-object task it reached 99.1% accuracy, using far less training than earlier capsule models.
Abstract · An Algorithm for Routing Capsules in All Domains
Building on recent work on capsule networks, we propose a new, general-purpose form of "routing by agreement" that activates output capsules in a layer as a function of their net benefit to use and net cost to ignore input capsules from earlier layers. To illustrate the usefulness of our routing algorithm, we present two capsule networks that apply it in different domains: vision and language. The first network achieves new state-of-the-art accuracy of 99.1% on the smallNORB visual recognition task with fewer parameters and an order of magnitude less training than previous capsule models, and we find evidence that it learns to perform a form of "reverse graphics." The second network achieves new state-of-the-art accuracies on the root sentences of the Stanford Sentiment Treebank: 58.5% on fine-grained and 95.6% on binary labels with a single-task model that routes frozen embeddings from a pretrained transformer as capsules. In both domains, we train with the same regime. Code is available at https://github.com/glassroom/heinsen_routing along with replication instructions.
Franz A. Heinsen
arXiv:1911.00792 · cs.LG, cs.AI, cs.CV · submitted Nov 2, 2019 · updated Feb 28, 2020
abstract · pdf · html
As it turns out, I posted it and answered a few questions about it on HN a few days ago, on this thread:
https://news.ycombinator.com/item?id=21397444
Please feel free to ask questions here too. I would be happy to answer them.