Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs 事件

Pair-In, Pair-Out: Latent Multi-Token Prediction for Efficient LLMs arXiv:2605.27255v1 Announce Type: new Abstract: Long chain-of-thought reasoning has made autoregressive decoding the dominant inference cost of modern large language models. Existing methods target either the input side (latent compression) or the output side (speculative decoding and multi-token prediction, MTP), but the two lines of work have been pursued independently. Moreover, output-side methods must incur an expensive ve