about
Compiling Agent Experience into Persistent Knowledge for Skill Evolution (arxiv.org)
7 points by tcp_handshaker 36 days ago | hide | past | pdf | discuss on HN

In plain words: Instead of letting lessons from past runs pile up in old logs, this system keeps a wiki of what worked and rewrites the agent's skill from it. It beats the best skill-evolution approaches, and skills learned by another model can beat a model's own.

Abstract · WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.

Liyan Tang, Cyrus Rashtchian, Chun-Sung Ferng, Andrew Tomkins, Da-Cheng Juan, Tu Vu
arXiv:2608.27454 · cs.AI, cs.CL · submitted Aug 27, 2026
abstract · pdf · html

add comment on HN
Also discussed: Aug 2026 (1 point, 0 comments)