From Answers to States: Verifiable Process-Level Evaluation of Chemical Reasoning in Large Language Models 事件

From Answers to States: Verifiable Process-Level Evaluation of Chemical Reasoning in Large Language Models arXiv:2606.03660v1 Announce Type: new Abstract: Large language models are increasingly used as chemistry assistants, yet most chemistry benchmarks still score only final answers. This masks a critical failure mode: a model may output the correct molecule, product, or option while its reasoning violates chemical logic. Existing process-level evaluators are hard to scale because LLM judges a