ornith_· @ornith_ · X·· 6 天前AI 评分
DFlash 草稿模型上线 Ornith-1.5 系列
DFlash 草稿模型现已支持 Ornith-1.5 的 9B、35B-A3B 和 397B 三个版本，与 Ornith 1.5 组成加速组合：DFlash 一次起草多个 token，Ornith 1.5 单次验证草稿 token 而非逐个生成。性能评测显示 DFlash 最高可实现 2.54× 加速，且生成质量无损失。
🪽DFlash draft models are available for Ornith-1.5 9B, 35B-A3B, and 397B.
DFlash and Ornith 1.5 make a dynamic duo: DFlash performs as the draft model, accelerating inference by drafting multiple tokens at once. Then Ornith 1.5 verifies the draft tokens in one pass instead of generating one token at a time.
👮 We conducted a performance evaluation of the DFlash models. DFlash achieves up to a 2.54× speedup without any loss in generation quality.
🔌 Come and plug this super buddy into your workstation.
huggingface.co/collections/o…
来源：ornith_ · x.com