about
Gram: Recursive reasoning models with stochastic latent trajectories (10M param) (arxiv.org)
3 points by mrkn1 136 days ago | hide | past | pdf | 1 comment on HN

In plain words: Instead of writing reasoning word by word, it repeatedly updates a hidden state with the same small step, adding randomness so several solution paths can be tried. It beat fixed-path versions on structured reasoning and multi-answer puzzles, and can generate examples with no input.

Abstract · Generative Recursive Reasoning

How should future neural reasoning systems implement extended computation? Recursive Reasoning Models (RRMs) offer a promising alternative to autoregressive sequence extension by performing iterative latent-state refinement with shared transition functions. Yet existing RRMs are largely deterministic, following a single latent trajectory and converging to a single prediction. We introduce Generative Recursive reAsoning Models (GRAM), a framework that turns recursive latent reasoning into probabilistic multi-trajectory computation. GRAM models reasoning as a stochastic latent trajectory, enabling multiple hypotheses, alternative solution strategies, and inference-time scaling through both recursive depth and parallel trajectory sampling. This yields a latent-variable generative model supporting conditional reasoning via $p_θ(y \mid x)$ and, with fixed or absent inputs, unconditional generation via $p_θ(x)$. Trained with amortized variational inference, GRAM improves over deterministic recurrent and recursive baselines on structured reasoning and multi-solution constraint satisfaction tasks, while demonstrating an unconditional generation capability. https://ahn-ml.github.io/gram-website

Junyeob Baek, Mingyu Jo, Minsu Kim, Mengye Ren, Yoshua Bengio, Sungjin Ahn
arXiv:2605.19376 · cs.AI · submitted May 19, 2026 · updated May 20, 2026
abstract · pdf · html

add comment on HN
Also discussed: May 2026 (7 points, 0 comments)

yesterday I tried to reproduce GRAM because there was no official code https://github.com/ad3002/gram On N-Queens 8x8 I get 87.58% valid solutions on one 3080Ti, paper reports 99.7%, but with much more compute