WAV: Multi-Resolution Block Residual Routing for Deep Decoder-Only Transformers 事件

WAV: Multi-Resolution Block Residual Routing for Deep Decoder-Only Transformers arXiv:2606.06564v1 Announce Type: cross Abstract: Residual connections are central to training deep Transformers, but standard PreNorm residual streams aggregate sublayer updates with fixed unit weights. Recent Attention Residuals replace this fixed accumulation with content-dependent depth-wise routing, and Block Attention Residuals make the mechanism efficient by routing over block-level residual summaries. Howeve