Google 论文提出 AIM:让研究智能体维护想法排序地图并校验代码一致性
Google 新论文提出研究智能体 AIM,通过维护一份按主题排序的想法地图,并检查代码是否与每个想法一致,让智能体更早获得更好结果。AIM 将想法归入排序主题,每轮在强主题和未测主题之间分配,并用审计器剔除被钻空子的结果、重新标注想法以匹配代码。
New Google paper shows research agents get better results sooner when they keep a ranked map of ideas and check that code matches each idea, so build both in.
Most agents just keep editing code.
When code drifts from the idea it's scored as, the agent learns the wrong lesson.
AIM sorts ideas into ranked themes and splits each round between strong themes and untested ones. An auditor tosses gamed results and relabels ideas to match the code.
It beat the best prior agent, ScientistOne, by 1.6 and 4.9 points on 2 task groups, and matched ScientistOne's best score up to 3.1x sooner.
Expect the biggest gains on tasks with many possible approaches and few good ones.
来源:rohanpaul_ai · x.com