about
Culturally transmitted color categories in LLMs reflect efficient compression (arxiv.org)
1 point by PaulHoule on Sep 22, 2025 | hide | past | pdf | discuss on HN

In plain words: The study tested how AI models name colors, then passed naming systems from one model to the next starting from random ones. Like humans, models reshaped them toward fewer, more accurate categories, but only the strongest reached humans' wide range of near-ideal tradeoffs.

Abstract · Evolution and compression in LLMs: On the emergence of human-aligned categorization

Converging evidence suggests that human systems of semantic categories achieve near-optimal compression via the Information Bottleneck (IB) complexity-accuracy tradeoff. Large language models (LLMs) are not trained for this objective, which raises the question: are LLMs capable of evolving efficient human-aligned semantic systems? To address this question, we focus on color categorization -- a key testbed of cognitive theories of categorization with uniquely rich human data -- and replicate with LLMs two influential human studies. First, we conduct an English color-naming study, showing that LLMs vary widely in their complexity and English-alignment, with larger instruction-tuned models achieving better alignment and IB-efficiency. Second, to test whether these LLMs simply mimic patterns in their training data or actually exhibit a human-like inductive bias toward IB-efficiency, we simulate cultural evolution of pseudo color-naming systems in LLMs via a method we refer to as Iterated in-Context Language Learning (IICLL). We find that akin to humans, LLMs iteratively restructure initially random systems towards greater IB-efficiency. However, only a model with strongest in-context capabilities (Gemini 2.0) is able to recapitulate the wide range of near-optimal IB-tradeoffs observed in humans, while other state-of-the-art models converge to low-complexity solutions. These findings demonstrate how human-aligned semantic categories can emerge in LLMs via the same fundamental principle that underlies semantic efficiency in humans.

Nathaniel Imel, Noga Zaslavsky
arXiv:2509.08093 · cs.CL · submitted Sep 9, 2025 · updated Mar 13, 2026
abstract · pdf · html · Published as a conference paper at ICLR 2026 (The Fourteenth International Conference on Learning Representations). OpenReview: https://openreview.net/forum?id=s7gSTR2AqA&noteId=s7gSTR2AqA

add comment on HN