In plain words: A tool that automatically rewrites prompts inside multi-step AI pipelines: it treats each prompt as adjustable and uses a fixed AI to give feedback and improve them, even in loops and mixed code-and-AI workflows. It beat earlier prompt-tuning approaches on both accuracy and training cost.
Abstract · LLM-AutoDiff: Auto-Differentiate Any LLM Workflow
Large Language Models (LLMs) have reshaped natural language processing, powering applications from multi-hop retrieval and question answering to autonomous agent workflows. Yet, prompt engineering -- the task of crafting textual inputs to effectively direct LLMs -- remains difficult and labor-intensive, particularly for complex pipelines that combine multiple LLM calls with functional operations like retrieval and data formatting. We introduce LLM-AutoDiff: a novel framework for Automatic Prompt Engineering (APE) that extends textual gradient-based methods (such as Text-Grad) to multi-component, potentially cyclic LLM architectures. Implemented within the AdalFlow library, LLM-AutoDiff treats each textual input as a trainable parameter and uses a frozen backward engine LLM to generate feedback-akin to textual gradients -- that guide iterative prompt updates. Unlike prior single-node approaches, LLM-AutoDiff inherently accommodates functional nodes, preserves time-sequential behavior in repeated calls (e.g., multi-hop loops), and combats the "lost-in-the-middle" problem by isolating distinct sub-prompts (instructions, formats, or few-shot examples). It further boosts training efficiency by focusing on error-prone samples through selective gradient computation. Across diverse tasks, including single-step classification, multi-hop retrieval-based QA, and agent-driven pipelines, LLM-AutoDiff consistently outperforms existing textual gradient baselines in both accuracy and training cost. By unifying prompt optimization through a graph-centric lens, LLM-AutoDiff offers a powerful new paradigm for scaling and automating LLM workflows - mirroring the transformative role that automatic differentiation libraries have long played in neural network research.
Li Yin, Zhangyang Wang
arXiv:2501.16673 · cs.CL · submitted Jan 28, 2025 · updated Jan 30, 2025
abstract · pdf · html
This must be what AI hype actually is. Complete incoherent language to explain a very straight forward concept.
This is just: LLMs judging intermediate node outputs, and reverse traversing the graph while doing so until it modifies the original prompt.