In plain words: It compares two kinds of structure on the same set of facts—what goes with what versus what causes what—to show they are not the same. By that logic, today's reinforcement learning is not a causal problem, even though an agent chooses actions.
Abstract
We use an analogy between non-isomorphic mathematical structures defined over the same set and the algebras induced by associative and causal levels of information in order to argue that Reinforcement Learning, in its current formulation, is not a causal problem, independently if the motivation behind it has to do with an agent taking actions.
Mauricio Gonzalez-Soto, Felipe Orihuela Espina
arXiv:1908.07617 · cs.AI, cs.LG · submitted Aug 20, 2019 · updated Sep 9, 2019
abstract · pdf · html