about
Promptomatix: An Automatic Prompt Optimization Framework for LLMs (arxiv.org)
1 point by felineflock on Jul 24, 2025 | hide | past | pdf | discuss on HN

In plain words: Promptomatix turns a plain task description into a prompt automatically, figuring out what you want, making practice examples, and refining the wording while keeping cost in mind. Across five task types it matched or beat existing prompt-tuning tools with shorter prompts and less computing.

Abstract · Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms natural language task descriptions into high-quality prompts without requiring manual tuning or domain expertise. Promptomatix supports both a lightweight meta-prompt-based optimizer and a DSPy-powered compiler, with modular design enabling future extension to more advanced frameworks. The system analyzes user intent, generates synthetic training data, selects prompting strategies, and refines prompts using cost-aware objectives. Evaluated across 5 task categories, Promptomatix achieves competitive or superior performance compared to existing libraries, while reducing prompt length and computational overhead making prompt optimization scalable and efficient.

Rithesh Murthy, Ming Zhu, Liangwei Yang, Jielin Qiu, Juntao Tan, Shelby Heinecke, Caiming Xiong, Silvio Savarese, Huan Wang
arXiv:2507.14241 · cs.CL, cs.AI · submitted Jul 17, 2025 · updated Jul 24, 2025
abstract · pdf · html

add comment on HN