River AI 推出私有化定制模型系统
River AI 推出定制模型系统，可将 API 部署到客户自有算力集群，团队经验来自 DeepMind、OpenAI 和 xAI。定制模型在内部工作流上的表现优于顶级前沿模型，成本仅为其 1% 或更低。作者预测未来 99% 以上 LLM token 将由高效定制小模型生成，因为针对特定领域训练的小模型通常胜过通用大模型。
Over the last few months at @river_ai_inc we’ve developed what we believe is the best system in the world for building your own internal custom models, driven by 10 years of experience training top models at DeepMind, OpenAI and xAI.
In order to best support our customers, we’ve decided to do something radical: We also deploy our API on-prem on your compute cluster, and if you don’t have compute we will help you find it.
Again and again we’ve seen that custom models designed for your own internal workflows outperform top frontier models on performance, at a fraction of the cost (1 percent or less).
We’re just at the beginning of the custom model era, but its already clear that in the future more than 99% of LLM tokens will be generated on efficient custom models. The economics of it are just too powerful, and it’s far easier than people think once you have the right tools in place.
The reason why small models will dominate is due to the physics of deep learning: A general model that can do everything needs more capacity and training it on the whole distribution of all tasks is more challenging, so the model will be larger and more expensive, and wont perform perfectly on every task. A small model trained on a targeted domain usually outperforms it.
来源：ibab · x.com