掌控自己的智能栈:从评测框架起步
Elvis Saravia 建议企业掌控自己的智能栈,先搭建评测框架(harness)和 evals,再逐步向下游投入。他指出开源模型运行与微调成本仍高,企业不必一次到位。自建 harness 可带来更多选择、解锁能力,并衡量下一步该在哪里投入;开源已成为智能时代生存与发展的路径。
Own your intelligence stack, folks!
I will never get tired of saying this. Your business's very existence is at play here.
But you don't have to do this all at once if you can't afford it. I mean, open models are still very expensive to run and tune.
If you want to start somewhere, I suggest the harness. Build your evals and quickly move down the stack.
The great part about building your own harness is that it gives you optionality, unlocks capabilities, and helps you measure where else in the intelligence stack you need to invest next.
So while open-source was an alternative in the old era, today it is how you survive and thrive in the age of intelligence.
来源:omarsar0 · x.com