about
The unreasonable effectiveness of pattern matching (arxiv.org)
3 points by chbint 254 days ago | hide | past | pdf | 2 comments on HN

In plain words: Large language models were given sentences with nearly every content word replaced by nonsense, like "He dwushed a ghanc zawk," and asked to recover the meaning. They did so from sentence structure alone, showing pattern matching is a real ingredient of understanding.

Abstract

We report on an astonishing ability of large language models (LLMs) to make sense of "Jabberwocky" language in which most or all content words have been randomly replaced by nonsense strings, e.g., translating "He dwushed a ghanc zawk" to "He dragged a spare chair". This result addresses ongoing controversies regarding how to best think of what LLMs are doing: are they a language mimic, a database, a blurry version of the Web? The ability of LLMs to recover meaning from structural patterns speaks to the unreasonable effectiveness of pattern-matching. Pattern-matching is not an alternative to "real" intelligence, but rather a key ingredient.

Gary Lupyan, Blaise Agüera y Arcas
arXiv:2601.11432 · cs.CL · submitted Jan 16, 2026 · updated Mar 5, 2026
abstract · pdf · html

add comment on HN
Also discussed: Jan 2026 (2 points, 0 comments) · Jan 2026 (7 points, 1 comment)

This is a good paper that is worth looking at in detail.
I confess it was disappointing for me. Their main claim seems to be that thinking comprises pattern matching and pattern completion--allowing them to say that LLMs do resemble something we humans do-- but that's essentially the idea behind the connectionist movement from the 1980's - the one out of which current DNN models came from. Perhaps a friend of 1960's symbolic AI would be unhappy with that claim, but there are not many of these around anymore (Gary Marcus is misrepresented as one such, but his view is that models should be hybrid, not purely symbolic).

Nowadays, the question about whether LLMs are "actually" doing something similar to human thinking revolves around other dimensions, such as whether they rely on emergent world-models or not. Whether such world models would require symbolic reasoning or not is a different matter.