about
AI Propaganda factories with language models (arxiv.org)
3 points by lknik on Sep 18, 2025 | hide | past | pdf | discuss on HN

In plain words: Small language models on ordinary computers can churn out persona-driven political messaging with no humans judging the output. The persona shapes the posts more than the model does, and when the AI must argue back, its ideology hardens and extreme content grows.

Abstract

AI-powered influence operations can now be executed end-to-end on commodity hardware. We show that small language models produce coherent, persona-driven political messaging and can be evaluated automatically without human raters. Two behavioural findings emerge. First, persona-over-model: persona design explains behaviour more than model identity. Second, engagement as a stressor: when replies must counter-arguments, ideological adherence strengthens and the prevalence of extreme content increases. We demonstrate that fully automated influence-content production is within reach of both large and small actors. Consequently, defence should shift from restricting model access towards conversation-centric detection and disruption of campaigns and coordination infrastructure. Paradoxically, the very consistency that enables these operations also provides a detection signature.

Lukasz Olejnik
arXiv:2508.20186 · cs.CR, cs.AI, cs.CY · submitted Aug 27, 2025
abstract · pdf · html

add comment on HN
Also discussed: May 2026 (6 points, 1 comment) · Jan 2026 (4 points, 1 comment)