In plain words: Large language models were given sentences with nearly every content word replaced by nonsense, like "He dwushed a ghanc zawk," and asked to recover the meaning. They did so from sentence structure alone, showing pattern matching is a real ingredient of understanding.
Abstract
We report on an astonishing ability of large language models (LLMs) to make sense of "Jabberwocky" language in which most or all content words have been randomly replaced by nonsense strings, e.g., translating "He dwushed a ghanc zawk" to "He dragged a spare chair". This result addresses ongoing controversies regarding how to best think of what LLMs are doing: are they a language mimic, a database, a blurry version of the Web? The ability of LLMs to recover meaning from structural patterns speaks to the unreasonable effectiveness of pattern-matching. Pattern-matching is not an alternative to "real" intelligence, but rather a key ingredient.
Gary Lupyan, Blaise Agüera y Arcas
arXiv:2601.11432 · cs.CL · submitted Jan 16, 2026 · updated Mar 5, 2026
abstract · pdf · html