about
Demasq: Unmasking the ChatGPT Wordsmith (arxiv.org)
1 point by PaulHoule on Nov 15, 2023 | hide | past | pdf | 1 comment on HN

In plain words: A detector that judges whether writing came from ChatGPT, trained to spot machine-text habits and to stay alert when people edit text to hide them. Unlike detectors built for a single topic, it identified ChatGPT writing accurately across five areas, from medicine to Reddit.

Abstract · DEMASQ: Unmasking the ChatGPT Wordsmith

The potential misuse of ChatGPT and other Large Language Models (LLMs) has raised concerns regarding the dissemination of false information, plagiarism, academic dishonesty, and fraudulent activities. Consequently, distinguishing between AI-generated and human-generated content has emerged as an intriguing research topic. However, current text detection methods lack precision and are often restricted to specific tasks or domains, making them inadequate for identifying content generated by ChatGPT. In this paper, we propose an effective ChatGPT detector named DEMASQ, which accurately identifies ChatGPT-generated content. Our method addresses two critical factors: (i) the distinct biases in text composition observed in human- and machine-generated content and (ii) the alterations made by humans to evade previous detection methods. DEMASQ is an energy-based detection model that incorporates novel aspects, such as (i) optimization inspired by the Doppler effect to capture the interdependence between input text embeddings and output labels, and (ii) the use of explainable AI techniques to generate diverse perturbations. To evaluate our detector, we create a benchmark dataset comprising a mixture of prompts from both ChatGPT and humans, encompassing domains such as medical, open Q&A, finance, wiki, and Reddit. Our evaluation demonstrates that DEMASQ achieves high accuracy in identifying content generated by ChatGPT.

Kavita Kumari, Alessandro Pegoraro, Hossein Fereidooni, Ahmad-Reza Sadeghi
arXiv:2311.05019 · cs.CR, cs.LG · submitted Nov 8, 2023
abstract · pdf · html · To appear in the Network and Distributed System Security (NDSS) Symposium 2024. 15 pages, 3 figures, 6 tables, 3 algorithms, 6 equations

add comment on HN

Aren't we done with this already? There's no point in trying to detect if someone used ChatGPT to write something. It's time to rethink education.