跳到正文
原文
rohanpaul_ai· @rohanpaul_ai · X·· 3 小时前AI 评分57

Marvell展示用光互连把HBM内存放到距GPU 50米外的模块

AI 导读

Marvell的Dave Lazovsky展示了一个用光子学把高带宽内存(HBM + DDR)放到距GPU最远50米外的小型模块,取代通常1.5毫米的贴装距离。原文称延迟保持在数百纳秒量级,内存与算力可各自独立扩展,AI集群可共享大容量内存而不必绑定加速器封装。

正文 · 原文

Marvell’s Dave Lazovsky is holding a tiny module that uses photonics to move high-bandwidth memory (HBM + DDR) as far as 50 meters away from the GPU.

this can sit up to 50 meters from a GPU instead of the usual 1.5 mm.

For the first time, memory no longer has to live right next to compute, letting AI clusters share massive capacity without being locked to the accelerator package.

Latency stays in the hundreds of nanoseconds, close enough for practical memory use.

Basically, Memory and compute now scale on separate axes instead of being locked together.

来源:rohanpaul_ai · x.com