about
Brain-Inspired Computational Intelligence via Predictive Coding (arxiv.org)
4 points by haltist on Sep 12, 2023 | hide | past | pdf | discuss on HN

In plain words: Predictive coding is a brain-inspired learning rule where each layer predicts what the layer below sends and passes up only its mistakes, instead of backpropagation's backward error signal. This survey traces its history and finds it already works in control and robotics while computing asynchronously.

Abstract · Brain-inspired Computational Intelligence via Predictive Coding

Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks trained with a learning algorithm called error backpropagation, always considered biologically implausible. To this end, recent works have studied learning algorithms for deep neural networks inspired by the neurosciences. One such theory, called predictive coding (PC), has shown promising properties that make it potentially valuable for the machine learning community: it can model information processing in different areas of the brain, can be used in control and robotics, has a solid mathematical foundation in variational inference, and performs its computations asynchronously. Inspired by such properties, works that propose novel PC-like algorithms are starting to be present in multiple sub-fields of machine learning and AI at large. Here, we survey such efforts by first providing a broad overview of the history of PC to provide common ground for the understanding of the recent developments, then by describing current efforts and results, and concluding with a large discussion of possible implications and ways forward.

Tommaso Salvatori, Ankur Mali, Christopher L. Buckley, Thomas Lukasiewicz, Rajesh P. N. Rao, Karl Friston, Alexander Ororbia
arXiv:2308.07870 · cs.AI, cs.LG, cs.NE · submitted Aug 15, 2023 · updated Oct 29, 2025
abstract · pdf · html · 26 Pages, 9 Figures

add comment on HN