跳到正文
原文
rohanpaul_ai· @rohanpaul_ai · X·· 3 天前精选AI 评分78

Moonshot AI 发布 Kimi K3.1 Pro 及 Highspeed 变体

AI 导读

Moonshot AI 发布 Kimi K3.1 Pro,并上线运行速度提升 2-3 倍的 Highspeed 变体,已接入 Kimi 应用与 API。K3.1 Pro 在 Terminal-Bench 4.0 得分 65.7%,低于 Claude Opus 5.5 的 0.7 分,但每任务平均成本更低;完整权重计划于 11 月 4 日发布以供独立复测。

推荐理由

材料汇总了 Kimi K3.1 Pro 的基准成绩、训练数据调整与上线安排,便于对照其编码、幻觉和业务操作表现。

正文 · 原文

Moonshot AI’s first update, the new Kimi K3.1 Pro

> Kimi K3.1 Pro scores 65.7% on Terminal-Bench 4.0, 0.7 points behind Claude Opus 5.5 and 7.5 ahead of GPT-6 Astra, at a lower average cost per task than either rival’s top runs.

> Moonshot saw exploit skill climb as post-training scaled, so it removed cyber-related data from mid-training and RL; on its internal xdev-bench-hard, pass@3 fell from 90.5% to 81.0%.

> The filtered model still solves 81.0% of those exploitation tasks against K3’s 33.3%, which Moonshot reads as general coding gains carrying into cyber work, while a third-party run of GPT-5.6 Sol solved 100%.

> On Moonshot’s internal hallucination stress test with tools, false claims fell from 23.4% for K3 to 8.3%, still above GPT-6 Astra’s 5.5% but well below Claude Opus 5.5’s 15.0%.

> The biggest jump is on Moonshot’s simulated business-operation test, where scores rose from 8.9 to 37, and K3.1 Pro also tops OfficeQA Pro v2 at 64.4 against Opus 5.5’s 62.2.

> Gains are uneven: K3.1 Pro scores 38.1 on Terminal-Bench Science against GPT-6 Astra’s 68.1 and Opus 5.5’s 63.3, while leading Agents’ Last Exam at 43.2 and Humanity’s Last Exam with tools at 70.0.

> K3.1 Pro and a Highspeed variant running 2-3x faster are live in Kimi’s apps and API, with full weights due by November 4 for independent reruns.

来源:rohanpaul_ai · x.com