跳到正文
原文
testingcatalog· @testingcatalog · X·· 3 小时前AI 评分51

Rock Matrix 开源 EdgeRock-4B 文本与图像推理模型

AI 导读

Rock Matrix 开源了 EdgeRock-4B,一款采用固定容量记忆的小型文本与图像推理模型。该模型将注意力 KV cache 固定大小,完整保留最近 1,024 个 token,并将较早的重要信息存入独立记忆库。Rock Matrix 报告称,其在 AIME 2024–2026 上的平均 pass@1 为 82.9%,而其测试的最强有界状态模型为 18.8%。

正文 · 原文

Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model with fixed-capacity memory.

EdgeRock-4B keeps its attention KV cache fixed in size by holding the last 1,024 tokens in full and saving important older details to a separate bank.

Standard language models keep a growing record of every token they read, so long chats and long reasoning take up more GPU memory over time.

Rock Matrix reports an 82.9% mean pass@1 on AIME 2024–2026, compared to 18.8% for the strongest bounded-state model it tested.

来源:testingcatalog · x.com