ChaosBench-Logic v2: Evaluating LLM Logical Reasoning over Dynamical Systems at Scale 事件

ChaosBench-Logic v2: Evaluating LLM Logical Reasoning over Dynamical Systems at Scale arXiv:2605.24305v1 Announce Type: cross Abstract: Standard accuracy on binary reasoning benchmarks hides critical failure modes: prior collapse, inconsistency under paraphrase, and inability to reason about parameter-dependent dynamics. We present ChaosBench-Logic v2, a 40,886-question benchmark over 165 dynamical systems with 27 FOL predicates and 78 axiom edges, together with CARE (Calibration- and Adversari