Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders 事件

Whisper Hallucination Detection and Mitigation via Hidden Representation Steering and Sparse AutoEncoders arXiv:2606.07473v1 Announce Type: cross Abstract: Whisper, a widely adopted ASR model, is known to suffer from hallucinations - coherent transcriptions generated for non-speech audio entirely disconnected from the input. We investigate whether hallucinations can be detected and mitigated through Whisper's internal representations. We extract audio encoder activations and evaluate two repres