In plain words: Small language models on ordinary computers can churn out persona-driven political messaging with no humans judging the output. The persona shapes the posts more than the model does, and when the AI must argue back, its ideology hardens and extreme content grows.
Abstract
AI-powered influence operations can now be executed end-to-end on commodity hardware. We show that small language models produce coherent, persona-driven political messaging and can be evaluated automatically without human raters. Two behavioural findings emerge. First, persona-over-model: persona design explains behaviour more than model identity. Second, engagement as a stressor: when replies must counter-arguments, ideological adherence strengthens and the prevalence of extreme content increases. We demonstrate that fully automated influence-content production is within reach of both large and small actors. Consequently, defence should shift from restricting model access towards conversation-centric detection and disruption of campaigns and coordination infrastructure. Paradoxically, the very consistency that enables these operations also provides a detection signature.
Lukasz Olejnik
arXiv:2508.20186 · cs.CR, cs.AI, cs.CY · submitted Aug 27, 2025
abstract · pdf · html
To understand why it is important to know this;
1) The New Era of Propaganda - https://www.cccb.org/en/w/articles/the-new-era-of-propaganda
2) AI propaganda has arrived; Vanderbilt experts call for action - https://news.vanderbilt.edu/2025/08/25/ai-propaganda-has-arr...
3) The Disinformation Machine: How Susceptible Are We to AI Propaganda? - https://hai.stanford.edu/news/disinformation-machine-how-sus...
4) The Era of A.I. Propaganda Has Arrived, and America Must Act - https://archive.is/n7UON
5) Generative propaganda: Evidence of AI’s impact from a state-backed disinformation campaign - https://academic.oup.com/pnasnexus/article/4/4/pgaf083/80979...