about
Prompt, Divide, and Conquer: Bypassing Large Language Model Safety Filters (arxiv.org)
1 point by consumer451 on Apr 2, 2025 | hide | past | pdf | 1 comment on HN

In plain words: A jailbreak attack splits a harmful request into harmless-looking pieces, sends each to a separate AI, then stitches the answers together to slip past safety filters. On hundreds of malicious coding prompts it succeeded 12% more often than sending the request to one model.

Abstract · Prompt, Divide, and Conquer: Bypassing Large Language Model Safety Filters via Segmented and Distributed Prompt Processing

Large Language Models (LLMs) have transformed task automation and content generation across various domains while incorporating safety filters to prevent misuse. We introduce a novel jailbreaking framework that employs distributed prompt processing combined with iterative refinements to bypass these safety measures, particularly in generating malicious code. Our architecture consists of four key modules: prompt segmentation, parallel processing, response aggregation, and LLM-based jury evaluation. Tested on 500 malicious prompts across 10 cybersecurity categories, the framework achieves a 73.2% Success Rate (SR) in generating malicious code. Notably, our comparative analysis reveals that traditional single-LLM judge evaluation overestimates SRs (93.8%) compared to our LLM jury system (73.2%), with manual verification confirming that single-judge assessments often accept incomplete implementations. Moreover, we demonstrate that our distributed architecture improves SRs by 12% over the non-distributed approach in an ablation study, highlighting both the effectiveness of distributed prompt processing and the importance of robust evaluation methodologies in assessing jailbreak attempts.

Johan Wahréus, Ahmed Hussain, Panos Papadimitratos
arXiv:2503.21598 · cs.CR, cs.AI, cs.LG · submitted Mar 27, 2025
abstract · pdf · html · 22 pages; 26 figures

add comment on HN