RouterPlus 聚合多团队需求获取批量 token 价格
RouterPlus 将多个团队的推理需求聚合为与供应商的一笔大额交易，让每个团队按自身流量份额享受批量折扣价，为小团队提供无需成为大买家即可获得批量定价的途径。它还会基于真实使用场景测试模型，选出成本最低且够用的模型，避免团队在所有任务上都为顶级模型付费。
Inference pricing has a size penalty. The best per-token rates go to whoever can commit the most volume.
RouterPlus groups demand from many teams into one large deal with a provider, and each team pays that rate on its share of the traffic.
Large buyers have done this with cloud commits for years. Applied to tokens, I’d guess it works best for popular open models, where many teams already want the same weights served on the same kind of hardware.
For a small team, this is a route to bulk pricing that doesn’t require being a bulk buyer.
They also test models on your real usage and pick the one that's good enough at the lowest cost. Many teams pay for a top model on every task when a cheaper one could do most of the work.
来源：rohanpaul_ai · x.com