跳到正文
原文
rohanpaul_ai· @rohanpaul_ai · X·· 8 小时前AI 评分62

Google DeepMind 论文:自进化智能体学得越快,遗忘旧任务越多

AI 导读

Google DeepMind 一篇新论文发现,通过编辑系统提示词、记忆或技能文件来自我进化的智能体,在任务流变化时会边学边忘。团队在主题、工作流或领域变化的任务流上对比了 ReasoningBank、GEPA 和 Meta-Harness,追踪各方法在当前任务上的增益与其他任务上的损失。

正文 · 原文

New Google DeepMind paper finds that self-improving agents forget as they learn, and the method that learned new tasks fastest broke old ones the most.

Self-evolving agents improve without retraining by editing their system prompt, memory, or skill files. In real use tasks keep shifting, and each edit made for 1 task also applies to every task that follows.

The team ran ReasoningBank, GEPA, and Meta-Harness on task streams that changed topic, workflow, or domain. They tracked how much each method learned on the current task and lost on the others.

GEPA learned the most, 6.2 points per block on average, and also lost the most elsewhere, 4.3 points. After it learned to ask users for missing details, a later block rewrote that rule and its 15.5-point gain fell to 2.5.

If your agent edits its own prompt or memory, keep task-specific rules separate and retest old tasks after every update.

来源:rohanpaul_ai · x.com