跳到正文
原文
abidlabs· @abidlabs · X·· 3 天前AI 评分56

Hugging Face 推出 ML Intern 论文复现功能,以 Agent 应对开放科学激励瓦解

AI 导读

Hugging Face 的 abidlabs 表示,随着大规模算力驱动的自主 Agent 不断产出发现,开放共享科学知识的激励正在瓦解:发现被商品化、低质量论文激增使突破难以被识别、企业更倾向把算力投向内部迭代而非公开发表。

正文 · 原文

🚨 The incentives to share scientific knowledge openly are crumbling.

Historically, researchers shared scientific knowledge for two primary reasons: (1) the prestige conferred by discovery, and (2) a sense of expanding the pool of human knowledge. Even within industry, scientific discovery was far too vast an endeavor for a single scientist or team to tackle alone. So scientists explored different frontiers, usually published their findings, and collectively moved the field forward.

However, as more scientific knowledge is uncovered simply by throwing massive compute at autonomous agents with minimal human intervention, these incentives are breaking down: (1) discoveries are becoming commoditized. If anyone could have found the same result simply by running the same agentic prompt with enough compute, the prestige of discovery and the pride in one's work disappears, a shift we are already witnessing in software engineering. (2) the explosion of low-quality, low-barrier publications makes genuine breakthroughs increasingly difficult to filter, discover, and appropriately credit. (3) and for companies, keeping discoveries proprietary is increasingly advantageous. Instead of publishing and waiting for the broader scientific community to build upon the work, an organization can simply turn its own compute back onto the problem to iterate faster internally.

In the short term, the incentives reward secrecy. But my goal -- and at Hugging Face, our goal -- is the sustainable, long-term expansion of human knowledge that survives individual, closed companies. So we have to build new tools that reward and facilitate open sharing of knowledge. If agents are accelerating discovery, we are going to figure out how to use agents and other tools to preserve scientific integrity.

Starting with this: Paper Reproductions with ML Intern -- we’ve made it possible to take a published paper and task agents with independently reproducing its experiments, helping create more signals (e.g. open artifacts) that can help identify high-quality work.

来源:abidlabs · x.com