LysandreJik· @LysandreJik · X·· 5 小时前AI 评分
transformers serve 新增决策模型功能
transformers serve 的有趣新增：你现在可以将 250 个 LLM & VLM 模型中的任何一个变成类似 JEV 的决策模型。 /v1/systemone 用模型的 logits 对一组决策进行打分。无需生成文本！ 哪一个能让 microducks 最快冲过终点线？
Fun addition to transformers serve: you can now turn any of the 250 LLM & VLM model into a JEV-like decision model.
/v1/systemone scores a set of decision with the model's logits. No need to generate text!
Which one of them can get microducks across the finish line fast?
来源：LysandreJik · x.com