about
Properties of Sparse Distributed Representations and Their Application to HTM (arxiv.org)
2 points by espeed on Jan 9, 2017 | hide | past | pdf | discuss on HN

In plain words: It studies sparse distributed representations, patterns where only a few of many bits are on at once, the way brain-like memory systems store information. The math shows why these patterns scale well, resist noise, and generalize, and gives rules for using them.

Abstract · Properties of Sparse Distributed Representations and their Application to Hierarchical Temporal Memory

Empirical evidence demonstrates that every region of the neocortex represents information using sparse activity patterns. This paper examines Sparse Distributed Representations (SDRs), the primary information representation strategy in Hierarchical Temporal Memory (HTM) systems and the neocortex. We derive a number of properties that are core to scaling, robustness, and generalization. We use the theory to provide practical guidelines and illustrate the power of SDRs as the basis of HTM. Our goal is to help create a unified mathematical and practical framework for SDRs as it relates to cortical function.

Subutai Ahmad, Jeff Hawkins
arXiv:1503.07469 · q-bio.NC, cs.AI · submitted Mar 25, 2015
abstract · pdf

add comment on HN
Also discussed: May 2015 (3 points, 0 comments)