about
Natural-Language Agent Harnesses (arxiv.org)
2 points by Jimmc414 187 days ago | hide | past | pdf | discuss on HN

In plain words: The setup around an AI agent that organizes a task run is usually buried in code; here it is a plain editable document a runtime turns into agent calls and checks. On coding, terminal, and computer-use tasks it matched code-based versions with shorter rules.

Abstract

Agent performance is strongly shaped by the surrounding harness: the external execution system around a model that organizes a task run. Yet this logic is usually buried in tightly coupled controller code, which makes harnesses hard to inspect, compare, transfer, and ablate. This paper asks whether the reusable design pattern of an agent harness can be represented as an executable natural-language object. We introduce Natural-Language Agent Harnesses (NLAHs), editable documents that describe run-level harness policy, and Intelligent Harness Runtime (IHR), a shared runtime that interprets these documents into agent calls, handoffs, state updates, validation gates, and artifact contracts. Across coding, terminal-use, and computer-use benchmarks, IHR-executed NLAHs achieve comparable task outcomes to code and prompted realizations, while exposing much shorter static harness policies. Module ablations further show that explicit harness modules are analyzable. These results suggest that agent harnesses can be turned from incidental glue around models into scientific representation objects.

Linyue Pan, Lexiao Zou, Shuo Guo, Jingchen Ni, Hai-Tao Zheng
arXiv:2603.25723 · cs.CL, cs.AI · submitted Mar 26, 2026 · updated May 18, 2026
abstract · pdf · html · revise paper

add comment on HN