about
DetectGPT: Detecting if a passage was written by a language model (arxiv.org)
5 points by cgwu on Jan 27, 2023 | hide | past | pdf | discuss on HN

In plain words: Text from a language model sits in a dip of the model's probability curve, so DetectGPT rewrites a passage and checks whether its score rises. It needs no training and caught machine-written fake news better than the best training-free check, scoring 0.95.

Abstract · DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvature

The increasing fluency and widespread usage of large language models (LLMs) highlight the desirability of corresponding tools aiding detection of LLM-generated text. In this paper, we identify a property of the structure of an LLM's probability function that is useful for such detection. Specifically, we demonstrate that text sampled from an LLM tends to occupy negative curvature regions of the model's log probability function. Leveraging this observation, we then define a new curvature-based criterion for judging if a passage is generated from a given LLM. This approach, which we call DetectGPT, does not require training a separate classifier, collecting a dataset of real or generated passages, or explicitly watermarking generated text. It uses only log probabilities computed by the model of interest and random perturbations of the passage from another generic pre-trained language model (e.g., T5). We find DetectGPT is more discriminative than existing zero-shot methods for model sample detection, notably improving detection of fake news articles generated by 20B parameter GPT-NeoX from 0.81 AUROC for the strongest zero-shot baseline to 0.95 AUROC for DetectGPT. See https://ericmitchell.ai/detectgpt for code, data, and other project information.

Eric Mitchell, Yoonho Lee, Alexander Khazatsky, Christopher D. Manning, Chelsea Finn
arXiv:2301.11305 · cs.CL, cs.AI · submitted Jan 26, 2023 · updated Jul 23, 2023
abstract · pdf · html · ICML 2023

add comment on HN
Also discussed: Jan 2023 (64 points, 0 comments)