about
The Architecture of a Biologically Plausible Language Organ (arxiv.org)
1 point by beefman on Jan 22, 2024 | hide | past | pdf | discuss on HN

In plain words: A simulated brain of neurons learns noun and verb meanings from a few sentences with sensory input, strengthening links between cells that fire together rather than pushing errors backward. It learns this, while the earlier version could only process language in a mature brain.

Abstract

We present a simulated biologically plausible language organ, made up of stylized but realistic neurons, synapses, brain areas, plasticity, and a simplified model of sensory perception. We show through experiments that this model succeeds in an important early step in language acquisition: the learning of nouns, verbs, and their meanings, from the grounded input of only a modest number of sentences. Learning in this system is achieved through Hebbian plasticity, and without backpropagation. Our model goes beyond a parser previously designed in a similar environment, with the critical addition of a biologically plausible account for how language can be acquired in the infant's brain, not just processed by a mature brain.

Daniel Mitropolsky, Christos H. Papadimitriou
arXiv:2306.15364 · cs.CL, q-bio.NC · submitted Jun 27, 2023
abstract · pdf · html · 9 pages, 4 figures

add comment on HN