跳到正文
原文
testingcatalog· @testingcatalog · X·· 4 小时前AI 评分50

Inworld 推出面向消费级应用的 LLM 推理 API

AI 导读

Inworld 推出 Inworld Inference,一个面向消费类 AI 应用的 LLM 推理 API,支持 Gemma 4、GLM、DeepSeek、MiMo 等开源模型。

正文 · 原文

Inworld just launched Inworld Inference, an LLM inference API built for consumer AI apps, serving open models including Gemma 4, GLM, DeepSeek, and MiMo.

> @inworld optimizes how each model runs to deliver faster responses for tutors, companions, games, and other consumer apps.

> On Gemma 4 26B, median time to first token is 0.17 seconds, compared with 0.61 seconds for the median of the other providers on OpenRouter - 3.6× faster.

> At the 95th percentile, time to first token is 0.31 seconds versus 2.42 seconds for the median of those providers - 7.8× faster.

> Developers can also set requests to switch automatically to a fallback model if the first model fails or takes too long.

来源:testingcatalog · x.com