In plain words: Starting from scratch, evolution mixes +, −, ×, ÷ to find formulas tuned to fixed-precision numbers, unlike Taylor series built for any accuracy. It found a 10-operation exponential formula accurate to 14 significant figures, over 6 orders of magnitude better than older same-size formulas.
Abstract · AutoNumerics-Zero: Automated Discovery of State-of-the-Art Mathematical Functions
Transcendental functions, such as the exponential, are central to scientific computing, yet they cannot be natively calculated by digital hardware. Instead, computers must approximate these functions by combining basic operations, such as $\{+, -, \times, ÷\}$, using methods like Taylor series. These methods were developed over centuries by mathematicians, who focused on approaches that could attain arbitrary accuracy. However, computers can handle most applications by using only finite-precision types, like float32, where any accuracy beyond the type's precision is effectively discarded. We explore, therefore, whether forgoing arbitrary accuracy can lead to the discovery of more efficient approximations. The evolutionary method of symbolic regression is particularly suitable, as it can search for arbitrary operation combinations and can optimize non-differentiable objectives, such as the number of operations used. Our results show that evolution can discover computer programs that outperform established methods in this setting, despite having no prior mathematical knowledge beyond the calculation of the basic operations. Starting from empty code, symbolic regression constructs programs representing novel mathematical expressions. In particular, we discovered a 10-operation program that approximates the exponential function to 14 significant figures, exceeding the accuracy of previously known approximations of this size by more than 6 orders of magnitude.
Esteban Real, Mirko Rossini, Connal de Souza, Manav Garg, Moritz Firsching, Quoc V. Le, Yao Chen, Akhil Verghese, Ekin Dogus Cubuk, David H. Park
arXiv:2312.08472 · cs.NE, cs.LG, math.NA · submitted Dec 13, 2023 · updated Jun 2, 2026
abstract · pdf · html · v2: Accepted to the International Conference on Machine Learning (ICML 2026); added results, clarified framing, and added proofs