Evaluating the Evaluator: Problems with SemEval-2020 Task 1 for Lexical Semantic Change Detection 事件

Evaluating the Evaluator: Problems with SemEval-2020 Task 1 for Lexical Semantic Change Detection arXiv:2604.13232v2 Announce Type: replace Abstract: This discussion paper re-examines SemEval-2020 Task 1, the most influential shared benchmark for lexical semantic change detection, through a three-part evaluative framework: operationalisation, data quality, and benchmark design. First, at the level of operationalisation, we argue that the benchmark models semantic change mainly as gain, loss, or