Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs 文章

ArXiv CS.CL2026-06-01NEWSen作者: Wenhui Tan, Minghao Li, Xiaoqian Ma, Siqi Fan, Xiusheng Huang, Liujie Zhang, Ruihua Song, Weihang Chen
大语言模型
查看原文 →
关系图谱

Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs · 相关技术

相关技术

AutoregressiveLLMODElanguage model多词元预测（MTP）草稿模型latent representationTokenSpeculative decodingSoft Actor CriticParts-of-Speech (POS) tagsNPUMulti-Instance RetrievalLMMlarge language modelsICTForFOLFFIDiTCodingchain-of-thoughtChain-of-thought reasoningCamouflaged object detectionARGANNTPU