Ekka: Automated Diagnosis of Silent Errors in LLM Inference 事件

Ekka: Automated Diagnosis of Silent Errors in LLM Inference arXiv:2606.04594v1 Announce Type: cross Abstract: LLM serving frameworks are quickly evolving with a complex software stack and a vast number of optimizations. The rapid development process can introduce silent errors where output quality silently degrades without any explicit error signals. Diagnosing silent errors is notoriously difficult due to the substantial semantic gap between the high-level symptoms and the low-level root cause