Google DeepMind 与 Stanford 研究图像符号对模型递归代码生成的影响
Google DeepMind 与 Stanford 的研究发现,在上下文中加入红色心形图片后,Claude Opus 4.7 和 GPT-5.4 在二叉树中序遍历任务中 100% 写出递归代码,黄色对勾则让 Gemini 3.1 Pro 在 90% 的样本中选择递归。
Super interesting paper from Google DeepMind and Stanford.
They find that if you put a picture of a red heart in the context, Claude Opus 4.7 and GPT-5.4 write recursive code 100% of the time.
They found this on inorder binary tree traversal, a problem with equally valid recursive and iterative solutions. A yellow checkmark pushes Gemini 3.1 Pro to recursion in 90% of samples.
The effect matches or comes close to telling the model directly to use recursion. Text captions of the same symbol steer much less, and random or naturalistic images steer less still.
The models cannot explain it. Their interpretations of the symbol and their thinking traces do not match what they do. For GPT-5.4, 74.7% of traces give the wrong reason.
When models send images to each other, they pick shapes that they and humans find intuitive, and those shapes often fail to steer the other model.
If your agents read screenshots or images, those inputs can change behavior in ways the reasoning trace will not show.
arxiv.org/abs/2610.36449
Chat with Paper: academy.dair.ai/papers/a-hea…
来源:dair_ai · x.com