SemiAnalysis_· @SemiAnalysis_ · X·· 2 天前AI 评分
GB300 NVL72 铜背板扩展至72卡
通过极致协同设计，GB300 NVL72 采用创新铜背板，将 scale-up 域从 Hopper 的 8 扩展到 72。这使得宽专家并行等优化成为可能，每个 GPU 只需持有部分专家子集，从而实现： 🟠 权重加载压力大幅降低 🟠 通过权重在多 token 间复用，算术强度大幅提升 (2/3)
Through extreme co-design, GB300 NVL72 uses an innovative copper backplane to expand the scale-up domain to 72 versus 8 on Hopper. This allows optimizations like wide expert parallelism, which allows each GPU to have only a subset of experts, resulting in:
🟠 Way lower weight-loading pressure
🟠 Way higher arithmetic intensity through the reuse of weights across many tokens (2/3)
来源：SemiAnalysis_ · x.com