Thomas Wolf：LLM 教学仍受知识诅咒所限
Thomas Wolf 指出 LLM 在 theory of mind 上仍很吃力，游戏 NPC 写故事时会假设玩家知道得更多，NPC 有时还会对从未发生的事做出奇怪反应。他认为 AI tutor 要建模学习者，但默认设置下仍不达标，LLM 容易出现"知识诅咒"（Curse of knowledge）。教学人类也难以构成可验证奖励（Verifiable Reward），在当前训练范式下难以规模化。
What's still very hard: theory of mind. The world, the voices and the mechanics were great. Writing the story was the weak part: the model assumes the player knows more than they do, and its NPC sometimes react in strange way or to things that never happened.
A Diamond Age's Primer (or any real AI tutor fwiw) will have to model the learner, and that is where it still falls short in a default setting imo. I've actually started exploring benchmarks on this and it's a hard task for LLMs right now. They are prone to the "Curse of knowledge". Teaching humans is also not very much a Verifiable Reward, so it's hard to scale within the current training paradigm.
来源：Thom_Wolf · x.com