GuillaumeLample· @GuillaumeLample · X·· 10 小时前AI 评分
Mistral 发布 Mistral Large 4 预览版,1T 参数原生多模态
Mistral 发布新模型 Mistral Large 4(ML4,代号 le Chonk)的预览版,该模型拥有 1T 参数、49B 激活参数,原生具备多模态能力。作者称其处于开源模型前沿,是来自美国或欧洲的最强开源权重模型;预览版背后的 RL 训练仍在进行且未见饱和迹象,最终版本与模型权重将在月底前发布。
Today, we are launching a preview of our new model, Mistral Large 4 (ML4), aka le Chonk 🐈.
ML4 is a 1T-parameter model with 49B active parameters, trained natively with multimodal capabilities.
It is at the frontier of open models, and by far the strongest open-weight model from the US or Europe.
The RL run behind this preview is still in flight and shows no sign of saturation -- we will release a final version before the end of the month along with the weights of the model.
🧵
1/n
来源:GuillaumeLample · x.com