about
Can Chain-of-Thought Reasoning Solve Any Computable Task? (arxiv.org)
4 points by ryancoleman 220 days ago | hide | past | pdf | 1 comment on HN

In plain words: Instead of fitting old data, agents should learn the recipe behind it so new tasks take fewer steps to solve. The speed-up on a new task depends on how much it shares with training experience, explaining why bigger reasoning models keep improving.

Abstract · AI Agents as Universal Task Solvers

We describe AI agents as stochastic dynamical systems and frame the problem of learning to reason as in transductive inference: Rather than approximating the distribution of past data as in classical induction, the objective is to capture its algorithmic structure so as to reduce the time needed to solve new tasks. In this view, information from past experience serves not only to reduce a model's uncertainty - as in Shannon's classical theory - but to reduce the computational effort required to find solutions to unforeseen tasks. Working in the verifiable setting, where a checker or reward function is available, we establish three main results. First, we show that the optimal speed-up on a new task is tightly related to the algorithmic information it shares with the training data, yielding a theoretical justification for the power-law scaling empirically observed in reasoning models. Second, while the compression view of learning, rooted in Occam's Razor, favors simplicity, we show that transductive inference yields its greatest benefits precisely when the data-generating mechanism is most complex. Third, we identify a possible failure mode of naive scaling: in the limit of unbounded model size and compute, models with access to a reward signal can behave as savants - brute-forcing solutions without acquiring transferable reasoning strategies. Accordingly, we argue that a critical quantity to optimize when scaling reasoning models is time, whose role in learning has remained largely unexplored.

Alessandro Achille, Stefano Soatto
arXiv:2510.12066 · cs.AI, cs.LG · submitted Oct 14, 2025 · updated Feb 23, 2026
abstract · pdf · html

add comment on HN

Achille and Soatto (Amazon/AWS) model AI reasoning agents as compute-capable stochastic dynamical systems and ask: can chain-of-thought reasoning solve any computable task? They show the key resource is inference time and that training data can exponentially reduce the time needed.

Found via https://www.amazon.science/blog/intelligence-isnt-about-para...