OpenRouter 更新多维度模型路由
OpenRouter 更新模型路由系统,允许模型提供商按成本、吞吐量、准确率等维度展示差异化。这一更新推动服务商改进服务引擎,以实际帮助终端用户。OpenRouter 称自身是最大的 token 开放市场,对 LLM 推理领域的竞争至关重要,并在算法初期变更中保持透明。
OpenRouter is the largest open market for tokens, and has been essential in bringing healthy competition to the LLM inference space.
Inference is complicated and can be optimized on multiple axes (cost, throughput, accuracy), so as an exchange they have the difficult task of deciding how to route between providers.
This update now allows providers to distinguish themselves across any/all of these axes, and has pushed providers like us to improve our serving engines in ways that actually help the end user.
It's been fun trying to red team the algorithm as OR shipped some of the initial changes, and we've really appreciated how transparent the team has been throughout the transtion.
If you haven't read up on the new system, you should check out the docs! It's really quite beautiful.
openrouter.ai/docs/guides/pr…
来源:EBorgnia · x.com