Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora 事件
PRODUCT_LAUNCH2026-05-27影响: MEDIUM
Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora arXiv:2605.27239v1 Announce Type: new Abstract: Annotation quality is difficult to sustain when campaigns span weeks or months with small annotator pools. We present a Setswana sentiment dataset of 3,565 tweets annotated by three native-speaker annotators across eight batches and examine why inter-annotator agreement (IAA) declines over time. Despite an aggregate Randolph's free-marginal Kappa of $\kappa = 0.76$, "excellent,
相关产品查看全部 (10)
相关报道查看全部 (1)
Temporal Simultaneity Predicts Annotation Quality in Sentiment Corpora
ArXiv CS.CL2026-05-27