karinanguyen· @karinanguyen · X·· 4 天前AI 评分
Anthropic 呼吁重视 AI 风险的早期证据
Anthropic 主张在危害规模化前重视 AI 风险的早期证据，并称其对 AI 赋能网络攻击的预警至少可追溯至 2022 年。当时 VC 并未认真对待这类风险；Anthropic 也在 ChatGPT 相关现实事件前数年构建了谄媚性评测。教训是风险只有变得可理解后才显得真实，等到事故发生再行动已太迟。
Anthropic has been warning about AI-enabled cyberattacks at least since 2022, with @logangraham at the forefront of that work. Back then, no VC was taking it seriously. The paradox is that risks only feel real once they’re legible, but waiting for incidents is too late. Anthropic also built sycophancy evals (@EthanJPerez et al.) a couple years before real-world incidents with ChatGPT made the risks of models excessively agreeing with users legible at scale. The lesson is to take early evidence of AI risks seriously before harm at scale makes them impossible to ignore.
来源：karinanguyen · x.com