ClaudeDevs· @ClaudeDevs · X·· 4 小时前AI 评分
Claude Messages API 降低首 token 延迟
在 API 侧，我们减少了 Messages API 在请求到达模型前的工作量，从而降低了首 token 延迟。请求在进入时也不再被缓冲，此外还有一系列较小的基础设施改进。
On the API side, we cut the work the Messages API does before your request reaches the model, which lowered time to first token. Requests are also no longer buffered on their way in, on top of a long list of smaller infra improvements.
来源：ClaudeDevs · x.com