Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models 事件

Chartographer: Counterfactual Chart Generation for Evaluating Vision-Language Models arXiv:2605.27311v1 Announce Type: cross Abstract: Chart question-answering (QA) benchmarks aim to pose questions that require visual reasoning to correctly answer, but models can often reach solutions through shortcuts or prior familiarity with a chart based on their own background knowledge. To strictly evaluate visual reasoning, we propose counterfactual charts where the chart-question task remains fixed, but