DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions 事件

DragOn: A Benchmark and Dataset for Drag-Based GUI Interactions arXiv:2606.06322v1 Announce Type: new Abstract: GUI agents - vision-based models that control desktops, web browsers, and mobile devices through graphical user interfaces - promise to automate a wide range of digital tasks. While million-scale datasets have enabled substantial progress on click-grounding, drag grounding (e.g. drag-and-drop, swipe, highlight) data remains an order of magnitude smaller and current models fall short o