about
Lattice Deduction Transformers (arxiv.org)
4 points by 44za12 123 days ago | hide | past | pdf | discuss on HN

In plain words: A small transformer that repeatedly narrows its internal state to only logically consistent possibilities, mimicking deduction like a puzzle solver. An 800K-parameter version solved two hard Sudoku sets perfectly at a fraction of the training cost of earlier reasoning models, and abstains instead of guessing.

Abstract

We introduce the Lattice Deduction Transformer (LDT), a recurrent transformer that approximates logically sound deduction by projecting its latent state through a lattice between forward passes. We train on-policy in a process that mirrors deduction in a search-based constraint solver and supervise training via a domain-agnostic, abstract-interpretation-based approximation of the set of solution candidates. An $800$K-parameter LDT achieves $100\%$ accuracy on Sudoku-Extreme and Snowflake Sudoku, at a fraction of the training cost of prior small recurrent reasoners, while remaining empirically sound: the model returns a correct answer or abstains. A $1.8$M-parameter variant reaches $99.9\%$ accuracy on Maze-Hard. Frontier LLMs score $0\%$ on all three benchmarks.

Liam Davis, Leopold Haller, Alberto Alfarano, Mark Santolucito
arXiv:2605.08605 · cs.LG, cs.AI, cs.LO · submitted May 9, 2026
abstract · pdf · html

add comment on HN