about
Reinforcement Learning for Symbolic Mathematics (arxiv.org)
7 points by MarcoDewey on May 21, 2025 | hide | past | pdf | discuss on HN

In plain words: A system writes candidate equations symbol by symbol, with a neural network proposing expressions and trial-and-error learning steering toward promising ones, to discover compact mathematical models automatically. On standard equation-finding tests it found more accurate, easier-to-read formulas than usual search methods.

Abstract · Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematics

Deep Symbolic Optimization (DSO) is a novel computational framework that enables symbolic optimization for scientific discovery, particularly in applications involving the search for intricate symbolic structures. One notable example is equation discovery, which aims to automatically derive mathematical models expressed in symbolic form. In DSO, the discovery process is formulated as a sequential decision-making task. A generative neural network learns a probabilistic model over a vast space of candidate symbolic expressions, while reinforcement learning strategies guide the search toward the most promising regions. This approach integrates gradient-based optimization with evolutionary and local search techniques, and it incorporates in-situ constraints, domain-specific priors, and advanced policy optimization methods. The result is a robust framework capable of efficiently exploring extensive search spaces to identify interpretable and physically meaningful models. Extensive evaluations on benchmark problems have demonstrated that DSO achieves state-of-the-art performance in both accuracy and interpretability. In this chapter, we provide a comprehensive overview of the DSO framework and illustrate its transformative potential for automating symbolic optimization in scientific discovery.

Conor F. Hayes, Felipe Leno Da Silva, Jiachen Yang, T. Nathan Mundhenk, Chak Shing Lee, Jacob F. Pettit, Claudio Santiago, Sookyung Kim, Joanne T. Kim, Ignacio Aravena Solis, Ruben Glatt, Andre R. Goncalves, et al.
arXiv:2505.10762 · cs.LG, cs.NE, cs.SC · submitted May 16, 2025
abstract · pdf · html · Under review in LNCS Computational Approaches to Scientific Discovery

add comment on HN