Advancing Direct Training for Spiking Neural Networks with Circulate-Firing Neurons and Learnable Gradients 文章

ArXiv CS.AI2026-05-28NEWSen作者: Feifan Zhou, Xiang Wei, Yang Liu, Qiang Yu

摘要

arXiv:2605.27412v1 Announce Type: cross Abstract: Spiking Neural Networks (SNNs) have emerged with promising energy-efficient property, yet a substantial performance gap persists compared to Artificial Neural Networks (ANNs). This gap stems from at least two key limitations: first, conventional spiking neurons offer limited information representation capacity, underutilizing the rich dynamics of membrane potentials; second, fixed surrogate gradient (SG) functions across time steps leads to imprecise gradient propagation, impeding effective direct training. To address these two challenges, we propose a new direct training algorithm with three core innovations: first, a circulate-firing spiking neuron model that enhances information representation capacity by leveraging membrane potentials more effectively; second, a time-step-wise learnable surrogate gradient function, enabling accurate gradient estimation during backpropagation;