Amazon 论文：LLM 可作为研究世界模型预测训练改动收益
Amazon 新论文提出用 LLM 作为研究世界模型，在实验运行前预测其收益，以帮助决定哪些实验值得消耗 GPU 时间。
New Amazon paper shows that an LLM can act as a research world model, predicting whether a training change will help before anyone spends GPU time on it.
AI research agents can propose experiments far faster than teams can afford to run them. Choosing what gets GPU time means guessing outcomes in advance.
They used an LLM as a research world model that predicts an experiment's gain before it runs. They tested it on 2,653 real experiment records from 9 setups, from pretraining to inference.
Past records from the same setup raised average ranking correlation with actual results from 0.506 to 0.774 across 5 setups. On the OLMo3-100M setup, adding records at low reasoning effort scored 0.892, while max effort without records reached 0.648.
If you run research agents, log every experiment, including failures, and feed those records to whatever model picks the next run.
来源：rohanpaul_ai · x.com