ConSA: Controllable Sparsity in Hybrid Attention via Learnable Allocation 文章

ArXiv CS.CL2026-06-17NEWSen作者: Yao Chen, Yinqi Yang, Junyuan Shang, Xiangzhao Hao, Simeng Zhang, Yilong Chen, Tingwen Liu, Shuohuan Wang, Dianhai Yu
查看原文 →
关系图谱

ConSA: Controllable Sparsity in Hybrid Attention via Learnable Allocation · 相关技术

相关技术

SWAIFAaugmented Lagrangian constraintL0 regularizationsliding-window attentionfull attentionConSA