X：AK (@_akhaliq)· @HuggingPapers·· 4 天前AI 评分
后训练在无关决策上留下行为影子：5,664 条单词教师答案让学生模型在 HumanEval+ 上提升 5.34pp
RT by @_akhaliq: Post-Training Leaves Behavioral Shadows on Unrelated Decisions With 5,664 single-word teacher answers, a student gains +5.34pp on HumanEval+ — without ever seeing code.
一项研究显示，仅用 5,664 条单词级教师答案做后训练，学生模型在从未见过代码的情况下于 HumanEval+ 上提升 5.34pp。该结果说明后训练会在与训练任务无关的决策上留下行为影子。
来源：X：AK (@_akhaliq) · x.lingyaoai.com