natolambert· @natolambert · X·· 6 小时前AI 评分
蒸馏一词被滥用混淆概念
如果把窃取 API key 的网络攻击也归入"蒸馏"这个术语下，那"蒸馏"这个词的用法就非常奇怪了。把向中国转移模型也归入同一术语也是一样的问题。目前不清楚为什么这类事件数量如此之高，以及它们与模型训练有什么关系。
There's something very odd going on with "distillation" if a cyber attack to steal api keys is looped under the same term. Same goes with looping together the model transfer stations to China. It's not clear why the volume is so high and how it's related to model training.
来源：natolambert · x.com