about
Driven by Compression Progress (Schmidhuber, 2008) (arxiv.org)
2 points by yamrzou on Jun 25, 2024 | hide | past | pdf | 1 comment on HN

In plain words: A limited learner finds data interesting only when it discovers new regularities that make it simpler to predict or describe. This rate of improvement in simplicity, not randomness or surprise alone, is proposed to explain curiosity, beauty, attention, and creativity in people and machines.

Abstract · Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes

I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once he learns to predict or compress the data in a better way, thus making it subjectively simpler and more beautiful. Curiosity is the desire to create or discover more non-random, non-arbitrary, regular data that is novel and surprising not in the traditional sense of Boltzmann and Shannon but in the sense that it allows for compression progress because its regularity was not yet known. This drive maximizes interestingness, the first derivative of subjective beauty or compressibility, that is, the steepness of the learning curve. It motivates exploring infants, pure mathematicians, composers, artists, dancers, comedians, yourself, and (since 1990) artificial systems.

Juergen Schmidhuber
arXiv:0812.4360 · cs.AI, cs.NE · submitted Dec 23, 2008 · updated Apr 15, 2009
abstract · pdf · html · 35 pages, 3 figures, based on KES 2008 keynote and ALT 2007 / DS 2007 joint invited lecture

add comment on HN
Also discussed: Nov 2024 (2 points, 0 comments) · Apr 2023 (1 point, 0 comments) · Apr 2023 (2 points, 0 comments) · Oct 2021 (15 points, 0 comments) · Jul 2020 (1 point, 0 comments) · Aug 2019 (1 point, 0 comments) · Jan 2017 (4 points, 2 comments)

Full title:

Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes