Conv-to-Bench: Evaluating Language Models Via User-Assistant Dialogues In Code Tasks 事件

PRODUCT_LAUNCH2026-05-27影响: MEDIUM

Conv-to-Bench: Evaluating Language Models Via User-Assistant Dialogues In Code Tasks arXiv:2605.26440v1 Announce Type: new Abstract: The rapid advancement of Large Language Models (LLMs) has outpaced the scalability of traditional evaluation benchmarks, which remain heavily dependent on labor-intensive expert curation. We address this bottleneck with Conv-to-Bench, a multi-stage framework that automatically transforms authentic multi-turn user-assistant dialogues into structured, verifiable req