NestedKV: Nested Memory Routing for Long-Context KV Cache Compression 文章

ArXiv CS.CL2026-05-27NEWSen作者: Hong Chen, Xiang Liu, Yubo Gao, Yuxuan Fan, Bo Wang, Yuanlin Chu, Yuanguo Lin, Xuming Hu
大语言模型
查看原文 →
关系图谱

NestedKV: Nested Memory Routing for Long-Context KV Cache Compression · 相关技术

相关技术

TTEODElanguage model一次性口令divide-and-conquer partitioningcosineattentionTokenStraight-Through EstimatorSULRepresentation AnchoringReferring expression comprehension (REC)MMLUMITLMMKV CacheForEcho-planar imagingDAPTContinuum Memory SystemANNLLaMA