about
Wanting to Be Understood (arxiv.org)
2 points by fzliu on Apr 14, 2025 | hide | past | pdf | discuss on HN

In plain words: In a two-agent simulation, agents got built-in rewards for exploring, or for copying, influencing, and anticipating each other. Curiosity alone didn't make them seek each other out, but rewards for mutual understanding did, and sparked cooperation even when only one agent was rewarded.

Abstract · Wanting to be Understood

This paper explores an intrinsic motivation for mutual awareness, hypothesizing that humans possess a fundamental drive to understand and to be understood even in the absence of extrinsic rewards. Through simulations of the perceptual crossing paradigm, we explore the effect of various internal reward functions in reinforcement learning agents. The drive to understand is implemented as an active inference type artificial curiosity reward, whereas the drive to be understood is implemented through intrinsic rewards for imitation, influence/impressionability, and sub-reaction time anticipation of the other. Results indicate that while artificial curiosity alone does not lead to a preference for social interaction, rewards emphasizing reciprocal understanding successfully drive agents to prioritize interaction. We demonstrate that this intrinsic motivation can facilitate cooperation in tasks where only one agent receives extrinsic reward for the behaviour of the other.

Chrisantha Fernando, Dylan Banarse, Simon Osindero
arXiv:2504.06611 · cs.LG, cs.AI, cs.CL · submitted Apr 9, 2025 · updated Apr 10, 2025
abstract · pdf · html

add comment on HN