natolambert· @natolambert · X·· 6 小时前AI 评分
开源模型与私有基准的取舍
私有基准测试往往显示开源模型落后更多，但私有基准测试的问题在于，你没有社区来替你解决那些不可避免的 bug。至于私有还是开源是最佳方案，我持 50/50 的看法。
Private benchmarks often show open models are further behind, but the problem with private benchmarks is you don’t have the community to squash the inevitable bugs for you. I'm 50/50 on if I think private or open-source is the best approach.
来源：natolambert · x.com