研究：同一模型下 agent harness 差异可使成本最高降 3 倍
DAIR.AI 推荐一篇论文，研究模型不变时 agent harness 会带来什么变化。作者用同一模型在 SWE-bench Verified 上运行 Claude Code。
Useful paper on what an agent harness changes when the model stays the same.
One takeaway: keep your harness prompt and tools small.
In this study, that can cut costs by up to 3x without lowering accuracy.
The authors ran Claude Code, mini-SWE-agent, and OpenCode with the same model on SWE-bench Verified. Claude Code and mini-SWE-agent scored within 5 points of each other on 447 tasks.
Swapping the harness changed results about as much as rerunning it. On a 45-task hard set, both flipped 13% of tasks.
The cost difference comes from the system prompt and tool schemas, which each harness sends again at every step. The more steps the agent takes, the more times you pay for them.
Paper: academy.dair.ai/papers/what-…
来源：dair_ai · x.com