Mitigating Staleness in Asynchronous Pipeline Parallelism via Basis Rotation 文章

ArXiv CS.AI2026-05-28NEWSen作者: Hyunji Jung, Sungbin Shin, Namhoon Lee
查看原文 →
关系图谱

Mitigating Staleness in Asynchronous Pipeline Parallelism via Basis Rotation · 相关技术

相关技术

coordinate basiscoordinate-wise adaptive optimizersstandard coordinate basisHessian eigenbasisgradient stalenessasynchronous pipeline parallelism