Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It? 事件

Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It? arXiv:2604.02028v2 Announce Type: replace Abstract: Diffusion models have become a standard approach for generative modeling in continuous domains, yet their application to discrete data remains challenging. We investigate why Gaussian diffusion models with the DDPM solver struggle to sample from discrete distributions that are represented as a mixture of delta-distributions in the continuous space. Using a toy Random Hi