omarsar0· @omarsar0 · X·· 5 天前AI 评分
recursive_si 发布 40B MoE 模型 Flint,开源权重并支持本地高速推理
recursive_si 发布首个模型 Flint,这是一款 40B MoE 模型,激活参数为 2.5B,并以 Apache 2.0 许可开放权重。Flint 在短上下文下可在 M4 Pro MacBook Pro 上达到 125+ tokens/s。
Bullish on automated AI research. Early signs of self-improving AI, no doubt.
Flint is the first model from @recursive_si. Their Eureka Machine contributed to nearly every part of the stack, from data and training recipes to the inference kernels, and the team built it from scratch in under four months!
It is a 40B MoE with 2.5B active parameters and open weights under Apache 2.0. It runs at 125+ tokens/s on an M4 Pro MacBook Pro at short contexts.
Highly recommend checking it out. We will be testing this in our internal autoresearch evals.
来源:omarsar0 · x.com