Influence-Inspired Spectral Rotations for Extreme Low-Bit LLM Quantization 事件

Influence-Inspired Spectral Rotations for Extreme Low-Bit LLM Quantization arXiv:2605.25203v1 Announce Type: cross Abstract: We apply the influence-adaptive Walsh geometry of a companion theory paper (arXiv:2605.01637) to extreme low-bit weight-only LLM quantization. The recipe is one math-invariant transformation: WHT-rotate each linear layer's weight matrix and rescale its columns by per-coordinate Walsh-basis activation energy before handing off to a reconstruction-error quantizer (Intel aut