SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning 论文

2021引用 364
DOI
Advanced Neural Network ApplicationsTopic ModelingDomain Adaptation and Few-Shot Learning
人工智能Advanced Neural Network ApplicationsDomain Adaptation and Few-Shot LearningTopic Modeling
相关技术:Topic ModelingDomain Adaptation and Few-Shot LearningAdvanced Neural Network Applications
关系图谱

SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning · 相关技术

相关技术

Topic ModelingDomain Adaptation and Few-Shot LearningAdvanced Neural Network Applications