In plain words: A fixed neural network could parse each image into its own part-whole tree by grouping identical vectors into "islands," where each island stands for one node. This is only a proposal, not a working system, but it should make transformer-like representations easier to interpret.
Abstract · How to represent part-whole hierarchies in a neural network
This paper does not describe a working system. Instead, it presents a single idea about representation which allows advances made by several different groups to be combined into an imaginary system called GLOM. The advances include transformers, neural fields, contrastive representation learning, distillation and capsules. GLOM answers the question: How can a neural network with a fixed architecture parse an image into a part-whole hierarchy which has a different structure for each image? The idea is simply to use islands of identical vectors to represent the nodes in the parse tree. If GLOM can be made to work, it should significantly improve the interpretability of the representations produced by transformer-like systems when applied to vision or language
Geoffrey Hinton
arXiv:2102.12627 · cs.CV · submitted Feb 25, 2021
abstract · pdf · html · 43 pages, 5 figures
https://syncedreview.com/2021/02/26/better-than-capsules-geo...
Given Hinton's track record, the dunking of this paper on social media due to the opening phrase seems unwarranted. If anyone in AI has earned the right to air speculative ideas-in-progress without an implementation and have it taken seriously, Hinton has.