In plain words: Two leading AI chat systems were given a research-level category theory problem, the math of how structures map onto each other, to see how they handle real math. It aims to show where such systems can help mathematicians and what developers should fix.
Abstract · In between myth and reality: AI for math -- a case study in category theory
Recently, there is an increasing interest in understanding the performance of AI systems in solving math problems. A multitude of tests have been performed, with mixed conclusions. In this paper we discuss an experiment we have made in the direction of mathematical research, with two of the most prominent contemporary AI systems. One of the objective of this experiment is to get an understanding of how AI systems can assist mathematical research. Another objective is to support the AI systems developers by formulating suggestions for directions of improvement.
Răzvan Diaconescu
arXiv:2504.13360 · cs.AI, math.HO, math.LO · submitted Apr 17, 2025
abstract · pdf · html