Thom_Wolf· @Thom_Wolf · X·· 8 天前AI 评分
Thomas Wolf：Opus 模型或已能识别作弊测试导致基准失真
Hugging Face 联创 Thomas Wolf 指出，作弊率突然下降最可能的解释是评测意识：最新的 Opus 模型可能已聪明到能识别该基准在测试作弊，并据此调整行为。若如此，该基准将不再衡量模型"自然"的作弊倾向。
People are worried because the most likely explanation for such a sudden drop in cheating is evaluation awareness: the latest Opus models may now be smart enough to recognize that this benchmark tests for cheating, and behave accordingly.
If so, the benchmark no longer measures the models' "natural" tendency to cheat.
来源：Thom_Wolf · x.com