In plain words: To make a chatbot write like a specific person, the system adds short notes on their usual words, names, and sentence patterns, plus other people's writing to show what sets them apart. This beat the usual approach of feeding past samples alone by 15%.
Abstract
Personalization with retrieval-augmented generation (RAG) often fails to capture fine-grained features of authors, making it hard to identify their unique traits. To enrich the RAG context, we propose providing Large Language Models (LLMs) with author-specific features, such as average sentiment polarity and frequently used words, in addition to past samples from the author's profile. We introduce a new feature called Contrastive Examples: documents from other authors are retrieved to help LLM identify what makes an author's style unique in comparison to others. Our experiments show that adding a couple of sentences about the named entities, dependency patterns, and words a person uses frequently significantly improves personalized text generation. Combining features with contrastive examples boosts the performance further, achieving a relative 15% improvement over baseline RAG while outperforming the benchmarks. Our results show the value of fine-grained features for better personalization, while opening a new research dimension for including contrastive examples as a complement with RAG. We release our code publicly.
Mert Yazan, Suzan Verberne, Frederik Situmeang
arXiv:2504.08745 · cs.IR, cs.AI, cs.CL · submitted Mar 24, 2025
abstract · pdf · html