testingcatalog· @testingcatalog · X·· 3 小时前AI 评分
Rock Matrix 开源 EdgeRock-4B 文本与图像推理模型
Rock Matrix 开源了 EdgeRock-4B,一款采用固定容量记忆的小型文本与图像推理模型。该模型将注意力 KV cache 固定大小,完整保留最近 1,024 个 token,并将较早的重要信息存入独立记忆库。Rock Matrix 报告称,其在 AIME 2024–2026 上的平均 pass@1 为 82.9%,而其测试的最强有界状态模型为 18.8%。
Rock Matrix has open-sourced EdgeRock-4B, a small text-and-image reasoning model with fixed-capacity memory.
EdgeRock-4B keeps its attention KV cache fixed in size by holding the last 1,024 tokens in full and saving important older details to a separate bank.
Standard language models keep a growing record of every token they read, so long chats and long reasoning take up more GPU memory over time.
Rock Matrix reports an 82.9% mean pass@1 on AIME 2024–2026, compared to 18.8% for the strongest bounded-state model it tested.
来源:testingcatalog · x.com