Harvard-MIT 论文:让智能体提前规划的提示词反而降低拍卖表现
一篇 Harvard-MIT 论文发现,在拍卖与匹配市场场景中,给智能体加“提前规划”或“考虑其他玩家”这类提示词会使其整体表现变差。作者采用已知最优策略的设定,可对每次选择打分;真正有效的是改变界面,例如一次只呈现一个安全选项的升序拍卖在四个模型家族上都减少了出价错误,直接说明收益结构和为何如实出价是安全的也有帮助。
Does telling your agent to plan ahead actually help?
It's standard practice to add a "plan ahead" or "think about the other players" instruction to an agent's prompt.
In auctions and matching markets, this Harvard-MIT paper finds that those prompts make play worse overall.
The authors use settings with known optimal strategies, so they can score every choice.
What helped was changing the interface.
An ascending auction, which presents one safe choice at a time, reduced bid errors across four model families. Plain descriptions of the payoffs and of why truthful bidding is safe also helped.
The agents' stated plans did not track their choices.
Interventions that improved bids left the measured reasoning quality in the plans unchanged, and some prompts improved the plans without improving bids.
The takeaway here is to evaluate a scaffold on the decisions it produces.
Paper: arxiv.org/abs/2609.36365
Chat with Paper: academy.dair.ai/papers/engin…
来源:dair_ai · x.com