MTSlive· @MTSlive · X·· 5 天前AI 评分
Arena CEO：付费生成的 benchmark 已失真
Arena CEO @ml_angelopoulos 表示，一旦开始付费让人生成 benchmark，它就不再是真实的评测，因为存在逆向选择问题。Arena 依靠持续流入的真实世界数据帮助人们改进实际任务，而非依赖某人花钱雇律师等凑出的私有数据集。他强调现实是唯一重要的评判标准。
Arena CEO @ml_angelopoulos explains why AI benchmarks stop being real the moment you start paying people to create them:
"We have a constant stream of fresh real world data that helps people improve for actual tasks, as opposed to some random benchmark where I created my private data set with whatever lawyers I could find to pay."
"There's an adverse selection problem. As soon as you're paying somebody to generate a benchmark, it's actually not real anymore."
"There's no better judge than reality. The real world is the only judge that matters."
@arena
来源：MTSlive · x.com