about
Mechanistic Interpretability of Emotion Inference in Large Language Models (arxiv.org)
3 points by cainxinth on Jun 30, 2025 | hide | past | pdf | discuss on HN

In plain words: They traced where large language models hold emotion judgments and found these live in a few specific parts of the network, not spread everywhere. Editing those parts, tied to how people appraise situations, steered the model's emotional output in predicted directions.

Abstract

Large language models (LLMs) show promising capabilities in predicting human emotions from text. However, the mechanisms through which these models process emotional stimuli remain largely unexplored. Our study addresses this gap by investigating how autoregressive LLMs infer emotions, showing that emotion representations are functionally localized to specific regions in the model. Our evaluation includes diverse model families and sizes and is supported by robustness checks. We then show that the identified representations are psychologically plausible by drawing on cognitive appraisal theory, a well-established psychological framework positing that emotions emerge from evaluations (appraisals) of environmental stimuli. By causally intervening on construed appraisal concepts, we steer the generation and show that the outputs align with theoretical and intuitive expectations. This work highlights a novel way to causally intervene and precisely shape emotional text generation, potentially benefiting safety and alignment in sensitive affective domains.

Ala N. Tak, Amin Banayeeanzade, Anahita Bolourani, Mina Kian, Robin Jia, Jonathan Gratch
arXiv:2502.05489 · cs.CL, cs.AI · submitted Feb 8, 2025 · updated Jun 30, 2025
abstract · pdf · html · ACL 2025 camera-ready version. First two authors contributed equally

add comment on HN